The Senior Data Engineer will specialize in building and optimizing data pipelines with Databricks and preparing datasets for Large Language Models (LLMs). This role will focus on designing scalable, efficient data architectures to support cutting-edge machine learning initiatives, particularly in generative AI applications. […]
· Design, implement, and optimize end-to-end data pipelines using Databricks and related technologies. […]
· Preprocess, clean, and structure diverse datasets (text, structured, and unstructured) for LLM training and fine-tuning. […]
· Work closely...