Kelly Services Data Engineer in Houston, Texas
Kelly Technology has an opening for a Data Engineer to work with our client in Houston
On site required
Duration: 6+ months
The Data Engineer supports the implementation of Company’s next generation digital platform. (S)he is responsible for building and delivering data models, executing data pipelines and ensuring accomplishment of business results. The Data Engineer works closely with company CTO, CISO, Chief Architect, Data Scientists and Partners to integrate the digital business priorities into a strategic and sustainable product roadmap.
Digital Platform is a next generation industry cloud focused on providing composite digital solutions for sub-surface, surface, corporate function, Private Equity and alternative energy. It combines and analyses data from portfolio companies, capital markets and industry sources to provide state of the art Data Driven insights.
Create and maintain optimal data pipeline architecture in cloud (Azure) that can be scalable.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Build the infrastructure (leveraging open source / vendor tools) required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build out new API integrations to support continuing increases in data volume and complexity
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Create data structures / tools for petro-technical and data scientist team members to assist them in building business intelligence applications, analytical solutions and predictive models.
Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
Lead development efforts using Agile / Scrum practices
Writes unit/integration tests, contributes to engineering wiki, and documents work.
Troubleshoots data related issues and assist in the resolution of data issues.
Works closely with a team of frontend and backend engineers, product managers, and analysts.
Maintain an awareness of emerging technologies, industry trends, and drives adoption of software engineering development best practices
5+ years relevant experience as (big) data engineer
Experience of Big Data tools like Azure analysis services, Azure Synapse Analytics, Azure Databricks and Azure HDInsight
Experience with NoSQL databases like Cassandra, MongoDB and Cosmos DB
Experience with relations databases like Oracle, MS SQL SERVER and MySQL databases
Experience of data ingestion tools like Azure Data Factory
Experience with Spark Streaming, Apache NiFi, Kafka and Azure Stream Analytics for real-time data processing
Experience of job schedulers and runbook automation using Azure Automation
Experience with data pipeline workflow management tools using Azure data factory, Oozie and SSIS
Experience with programming languages: Python, Scala, Julia, Java, etc.
Experience in Azure DevOps
Experience with source code control environments like GIT
Strong analytic skills related to working with unstructured datasets
Detailed knowledge of data lifecycle activities such as data definitions, data lineage and implementation of a data quality management framework
Energy domain expertise in E&P is a plus.
Candidate must have completed at least undergraduate degree in physical sciences or engineering
Strong communication skills and the ability to effectively discuss with business partners at the appropriate level of technical detail
If you are interested, please email your resume to email@example.com
Why Kelly ® ?
By partnering with Kelly® Technology, you’ll have direct connections to top companies around the globe—giving you the chance to put your tech skills to work on some of today’s most intriguing, innovative, and high-visibility projects. In a world where change is the only constant, our unparalleled connections and IT market expertise help you take your skills exactly where you want to go. We’re here to help you gain experience, keep learning, and move your career forward.
About Kelly ®
At Kelly, we’re always thinking about what’s next and advising job seekers on new ways of working to reach their full potential. In fact, we’re a leading advocate for temporary/nontraditional workstyles, because we believe they allow flexibility and tremendous growth opportunities that enable a better way to work and live (plus, did we mention we provide a ton of benefits ?). Connecting great people with great companies is what we do best, and our employment opportunities span a wide variety of workstyles, skill levels, and industries around the world.
Kelly is an equal opportunity employer committed to employing a diverse workforce and providing accommodations for people with disabilities in all parts of the hiring process as required under its Employment Accommodation Policy. Kelly will work with applicants to meet accommodation needs that are made known to Kelly in advance.
- Kelly Services Jobs