BIG DATA ENGINEER (REMOTE WORK)
Full Time
India
Posted 3 years ago
Dear Candidate,
We are urgently looking for BIG DATA ENGINEER for our prestigious client. Kindly find a detailed job description
Designation : BIG DATA ENGINEER
CTC : Not a constraint for right candidate
Job Location : WFH (REMOTE WORK)
General Duties & Responsibilities
- Working across a number of business areas providing development, maintenance and support
- Working as part of a team and occasionally solo developments as the business needs arise
- Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales
- Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction,
- transformation, and loading across multiple game franchises.
- Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members.
- Interacts with engineering teams and ensures that solutions meet customer
- requirements in terms of functionality, performance, availability, scalability, and reliability.
- Works directly with business analysts and data scientists to understand and support their use cases
- Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions.
- Designing and maintaining data systems and databases; this includes fixing coding errors and other data-related problems.
- Mining data from primary and secondary sources, then reorganizing said data in a format that can be easily read by either human or machine.
- Using statistical tools to interpret data sets, paying particular attention to trends and patterns that could be valuable for diagnostic and predictive analytics efforts.
- Demonstrating the significance of their work in the context of local, national, and global trends that impact both their organization and industry.
- Preparing Dashboards as a Self-Service BI for executive leadership that effectively communicate trends, patterns, and predictions using relevant data.
- Collaborating with programmers, engineers, and organizational leaders to identify opportunities for process improvements, recommend system modifications, and develop policies for data governance.
- Creating appropriate documentation that allows stakeholders to understand the steps of the data analysis process and duplicate or replicate the analysis if necessary.
- Select appropriate datasets and data representation methods
- Keep abreast of developments in the field
- Help identify probable causes and provide immediate solution during an incident
- Work within an agile environment following an agile framework.
- Contribute significant ideas for making the applications better and easier to use
- Participate in cutting edge research in artificial intelligence and machine learning applications.
- Contribute to engineering efforts from planning and organization to execution and delivery to solve complex, real-world engineering problems.
Skills and Experience
- Preferred skills in noSQL, Pig, Matlab, SAS, Java, Ruby, C++, Perl, and APIs to work with available data sources
- Evaluate and improve all aspects of our existing ETL system
- Experience with big data tools and architectures, such as Cloudera Hadoop, HDFS,Hive, BigQuery, Snowflake and Spark.
- Experience in Python programming language and frameworks such as Flask, AIOhttp
- Understanding of data structures, data modelling and software architecture
- Advanced knowledge of SQL queries
- Working knowledge of telematics interfaces and streaming solutions (MQTT, NiFi, Kafka,etc.).
- Experience with Cloud platforms such as Google cloud platform, AWS would be plus
- Ability to work in a team
- Outstanding analytical and problem-solving skills
- Experience in multi-threading, message queues, WebSockets
- Experience with automation of the development and test processes through CI/CD pipeline (Gitlab, SonarQube, Artifactory, Docker containers)
- Intermediate knowledge of API development
- Proving track record in building high performance, highly available and scalable systems
Job Qualifications
- Bachelor’s degree in Computer Science, or related technical field, or equivalent work experience.
- 3 – 5 years of relevant work experience.
- Experience designing and implementing distributed software systems (e.g Python).
- Research or Industry experience in Big Data, Artificial Intelligence, Machine Learning (ML) models, ML infrastructure, Natural Language Processing or Deep Learning.
- Good oral and written English communication skills
- Strong grasp of established and emerging technologies, systems, platforms, and software
- Ability to organize and manage multiple priorities
- Technical curiosity – Willingness to explore and learn new technologies that are unfamiliar
- Ability to work in a fast pace delivery oriented environment
- Ability to deliver short term results while invest in long term strategic solutions
- Self-starter, and Self-motivated and able to learn independently
- Team player who is eager to help others to succeed
If interested kindly revert with your updated resume asap
Job Features
Job Category | IT |