Data Engineer
Columbia, SC
$100,000
ShortList is looking for a Data Engineer to underpin a new AI programme of work for a leading not-for-profit in Columbia, SC. The Data Engineer will work as part of a project team to improve the data solutions across the organization. The role is hybrid with four days per week in office in central Columbia.
Key Responsibilities for the Data Engineer role:
- Collaborate with business teams to develop BI and AI models.
- Integrate with third-party systems using APIs for data processing and extraction.
- Design, build, and maintain robust data pipelines for analytics, reporting, and machine learning.
- Develop and optimize ETL processes in Microsoft Azure.
- Create and manage queries, views, tables, and stored procedures in SQL Server.
- Maintain and improve Databases, Data Warehouses, and related infrastructure.
- Ensure compliance with organizational data security policies.
Key skills for the Data Engineer role
- Degree in IT, Computer Science, or equivalent
- Up to 5 years of experience in SQL development, incl T-SQL (non negotiable)
- Minimum of 3 years experience of Python and Data Automation
- Experience with SQL Server Agent and security management
- Commercial experience with Azure SQL
- Experience working with complex API's to integrate 3rd party systems
This Data Engineer role is ideal for an individual who wants to work on AI-related projects and who enjoys complex integration scenarios.
The role does require you to be in office 4 days per week in Columbia SC, and be a U.S. Citizen or Green Card Holder. I can not consider applications requiring sponsorship at this time.
Click Apply now to be considered for the Data Engineer role .