Job Role: Data Analyst ( Databricks, Apache Spark, and Delta Lake, GenAI or AI/ML integrations ). […]
Design, implement, and optimize end-to-end data pipelines using Databricks and related technologies.
Build workflows to handle large-scale data ingestion, transformation, and storage. […]
Preprocess, clean, and structure diverse datasets (text, structured, and unstructured) for LLM training and fine-tuning. […]
Work closely with data scientists, ML engineers, and other stakeholders to understand data requirements for LLM technology requirements. […]
Implement processes to ensure data quality, consistency...