Job Description

Title: Senior Databricks AI Engineer/Data Scientist

Location: Louisville, KY (Remote)

Type: Contarct

Key Responsibilities:

• Design, build, and optimize AI/ML pipelines on Databricks, including compute management, Unity Catalog integration, and automated workloads.
• Develop, deploy, and maintain machine learning models from concept to production, including hyperparameter tuning and performance monitoring.
• Integrate and utilize OpenAI APIs to support advanced NLP, LLMs, and generative AI solutions.
• Lead computer vision initiatives, including OCR-based automation and document intelligence.
• Collaborate with cross-functional teams to translate business objectives into actionable data science solutions.
• Ensure data quality, security, and compliance across all analytics workflows.

Required Qualifications:

• Bachelor s or Master s degree in Computer Science, Data Science, Engineering, or related field.
• At least 5 years of professional Python programming experience.
• Minimum 3 years of hands-on experience with Databricks or similar cloud analytics platforms, including compute orchestration, Unity Catalog, and workload automation.
• At least 3 years of experience integrating and developing solutions with OpenAI and LLM APIs.
• Minimum 3 years of experience in applied machine learning, including lifecycle management from research to production deployment.
• Hands-on expertise with Large Language Models (LLMs) and computer vision, particularly OCR technologies.
• Strong experience with version control systems, especially GitHub.
• Excellent communication, documentation, and problem-solving skills.

Preferred Qualifications:

• Experience in data engineering (data pipeline development, ETL, data modeling).
• Prior exposure to ServiceNow (cmdb, secops, etc)

• Initial portfolio of AI projects (Candidate will work on at least 4 of these):
• Project 1: Vulnerability Analysis at Scale (GenAI - GPT 4.0 & GPT-4 Mini 0)
• Project 2: DGPO Data Quality (Machine Learning - Hyperparameter Tuning)
• Project 3: PIRC Automation (GenAI - GPT 4.0 & GPT-4 Mini 0)
• Project 4: IAE Email System (GenAI - GPT 4.0 & GPT-4 Mini 0)
• Project 5: Dynamic Data Classification/Masking (presidio)
• Project 6: Dynamic Meta Generation - AI Assistant across Databricks Unity Catalog
• Project 7: Contract Technology Requirement Analysis (GenAI - GPT 4.0 & GPT-4 Mini 0)
• Project 8: Predictive Intelligence (Portable codebase for predicting forecasting for IT Ops - (Neural Prophet/Prophet or (SARIMA))

Job Tags

Similar Jobs