AI Project Lead

KCDA’s AI Project Lead will help scope, plan and deliver AI-enabled solutions to assist prosecutor workflows. The AI Project Lead will report to the Director of Application Development as part of the Application Development Team, and work collaboratively with Executive stakeholders and end-users to architect scalable AI/ML solutions. The AI Project Lead will act as a trusted advisor in responsibly building tools to serve the Office’s core mission of seeking justice. In this role, the AI project lead will lead a team of developers to participate in early-stage ideation sessions, survey prosecutor defined use-cases, explore multiple solutions, build technology stacks, test and train products for viable outcomes, and deploy enterprise-wide solutions. A successful candidate must have technical skills required for AI application development, project management experience, and a demonstrated ability for strategic planning.

Key responsibilities:
- Analyze, design, implement, maintain, and support AI applications and monitoring solutions for enterprise infrastructure systems and platforms.
- Knowledge of infrastructure for AI/ML related tasks (Cloud and on-prem) is required.
- Technical competency in Python is required.
- A successful candidate must be proficient with AI application architecture scoping and design, and proficiency with LLM fine tuning using frameworks such as HuggingFace, LoRA, or PEFT.
- Account for and mitigate risks during design and implementation regarding data security, data integrity, and AI veracity; implement AI audit logging, explainability mechanisms, and human-in-the-loop workflows.
- A successful candidate will have proficiency with implementing LLM guardrails including hallucination mitigation, PII detection and output validation.
- Review and draft training and internal governance, ensuring compliance with agency standards, propose updates to agency standards in line with industry advancements.
- Train, upskill, supervise, and mentor project teams.
- Communicate with end-users, executive stakeholders and IT supervision regarding use cases, project plans, and recommendations.
- Test local solutions; manage on-premises GPU infrastructure for AI inference and training.
- Test cloud compute. Experience with Azure, AWS, and/or GCP is required.
- Design and deploy retrieval-augmented generation (RAG) pipelines, test hybrid environments.
- Oversee testing and reporting of quality assurance and quality control of AI use cases.
- Oversee scale-up, training, and deployment.
- Oversee Event Management, Patch Management, Release Management, Change Management development and processes.
- Monitor industry developments, liaise with vendors regarding new products and technologies.

Preferred Skills:
- Experience managing on-premises GPU infrastructure for AI inference and training workloads.
- User training experience.
- Experience with implementing confidentiality, data security and data integrity protocols; familiarity with government or legal sector data governance requirements including data residency and PII handling.
- Proficiency with the implementation, deployment, and integration of AI applications.
- Experience with automated document processing or de-identification pipelines for sensitive information.
- Experience with speech-to-text pipelines and multilingual NLP or translation workflows.
- Experience with prompt engineering, retrieval-augmented generation, agent/tool-use frameworks, containerization and orchestration of AI workloads.
- Experience with vector databases, including chunking strategies, embedding model selection, and hybrid search approaches; proficiency with embedding models and retrieval evaluation techniques.
- Ability to benchmark and produce metrics on LLM performance, experience with ML experiment tracking, model versioning, and reproducibility practices.
- Ability to effectively communicate AI planning with executive stakeholders.
- Ability to train, upskill, and lead a team of developers.
- Ability to provide technical guidance on internal AI policy.
- Ability to assess and evaluate vendor-provided solutions.

IT AUTOMATION AND MONITORING E - 95712

1. A baccalaureate degree in computer science, engineering or a related field from an accredited college and four years of satisfactory full-time experience related to IT automation engineering, monitoring engineering, management of infrastructure; or

2. Eight years of satisfactory full-time experience related to IT automation engineering, monitoring engineering, management of infrastructure;

3. Education and/or experience which is equivalent to "1" or "2" above.

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.