Job Description
Overview
We are seeking a passionate and autonomous Multimodal AI Engineer to contribute to innovative projects in the field of multimodal foundation models, focusing on LLMs, image, and clinical data analysis.
Role and Responsibilities
- Collaborate with a dynamic team pushing AI and machine learning boundaries in healthcare.
- Build real-world products for Electronic Health Record (EHR) systems.
- Research data curation, preparation, and training of state-of-the-art foundation models.
- Address some of the hardest problems in computer science.
Location
- Based in the San Diego metropolitan area.
- Candidates must reside locally or be willing to relocate.
Requirements
- Master’s degree in Computer Science (focus on LLM and multimodal models).
- Programming Skills: Python, C/C++.
- Frameworks and libraries: PyTorch, NLTK, spaCy, scikit-learn.
- Experience with deep learning architectures: ViT, SWIN transformer, GPT, CLIP.
- Knowledge of model compression, distributed training techniques.
- Publications and contributions to ML communities.
- Additional Plus Skills:
- Parameter-efficient tuning (QLoRA)
- Prompt engineering & fine-tuning Llama 2 or PaLM 2.
- CUDA programming.
- Imaging processing tools: OpenCV, VTK, ITK, DCMTK, Albumentations.
- Vector databases: Chroma, Pinecone, Milvus, Redis.
- Human-in-the-loop, RLHF.
- Knowledge of Stable Diffusion, OpenJourney, DeepFloyd IF.
Benefits
- Salary Range: $185,000 - $215,000 in San Diego.
- Comprehensive medical and dental coverage.
- Generous 401(k) plan.
- Regular events and activities.
- Wellness programs including onsite nutritionist and personal trainer.
Diversity and Inclusion
- Complies with ADA and EEO/AA/M/F/Veteran/Disabled policies.
Responsibilities Highlights
- Work with a team on AI in healthcare.
- Research on data curation and training.
- Engage in wellness activities.
Qualifications Highlights
- Location in San Diego or willing to relocate.
- Master’s in Computer Science (focus on LLM & multimodal models).
- Strong programming skills in Python and C/C++.
- Experience with PyTorch, NLP libraries.
- Knowledge of deep architectures and distributed training.
- Publications in leading ML conferences.
Salary & Employment Details
- Competitive salary based in San Diego.
- Range: $185,000 to $215,000.
- Includes benefits such as health coverage, 401(k), and more.