AI Engineer - Governance Intelligence, Third Party (India)

About Credo AI Credo AI is a venture-backed company on a mission to empower organizations to responsibly build, adopt, procure and use AI at scale. Credo AI has built a pioneering platform for context-driven AI governance, AI risk assessment and compliance (to regulations like the EU AI Act and standards like NIST AI RMF, ISO 42001 etc) to ensure compliant, fair, and auditable development and use of AI. Our goal is to move responsible AI development from an “ethical” choice to an obvious one-by ensuring AI’s benefits are universally accessible while addressing the full spectrum of its risks. We aim to do this both by making it easier for organizations to integrate responsible AI Governance practices into their AI development and by collaborating with regulators/policymakers to set up appropriate ecosystem incentives. Founded in 2020, Credo AI has been recognized as a one of the Most Innovative Companies of 2024 by Fast Company, a Technology Pioneer by the World Economic Forum, named to the CBInsights' AI 100 List and World's Most Promising Startups list, and included in Fast Company’s Next Big Thing in Tech and Intelligent Applications Top 40 by Madrona, Goldman Sachs, Microsoft and Pitchbook. About Us Credo AI is a leading AI governance platform helping enterprises implement responsible AI at scale. We are building the next generation of AI-powered governance solutions that enable organizations to manage risk, ensure compliance, and scale their AI deployments with confidence. About the Role Enterprise AI risk teams struggle to maintain current intelligence on their AI vendors and third-party models. Information is scattered across system cards, benchmark leaderboards, security disclosures, and vendor documentation—all constantly evolving. Manual tracking doesn't scale. You will build intelligent systems that transform AI vendor and model information, AI benchmarks (building off of our Model Trust Scores work), risk frameworks, and complex regulatory requirements into a structured knowledge graph usable by our AI systems. This is a full-time remote role for an AI Engineer focused on automated content generation and interpretation to power our AI Governance Intelligence Engine. Your work will enable organizations to automatically maintain comprehensive, up-to-date governance programs as regulations evolve, AI tools and capabilities change, and organizational AI footprint expands. Your work directly creates governance artifacts that would traditionally require extensive manual effort. This role is critical to scaling AI governance beyond what human teams can manually maintain. Key Responsibilities Build automated vendor intelligence pipelines that continuously collect and parse AI system cards, model benchmarks (MMLU, HumanEval, etc.), security disclosures, and public vendor documentation Design synthesis systems that map disparate vendor information to our risk taxonomy—translating technical capabilities into governance-relevant risk signals Implement quality evaluation for generated risk profiles, ensuring accuracy and detecting when vendor information conflicts or becomes stale Create adaptive interpretation systems that adjust risk assessments based on organizational context and risk appetite Research and prototype novel approaches to multi-source information synthesis and cross-vendor comparison About You You understand the AI assurance ecosystem—the difference between a capability benchmark and a safety evaluation, why model cards matter, what questions risk teams actually need answered about vendors. You've probably wrestled with inconsistent documentation formats and know the pain of keeping vendor information current. You have a keen eye for structure in unstructured text and can design systems that extract meaning while maintaining nuance. You understand that governance content must be both accurate and actionable. Minimum Qualifications Strong track record building LLM-powered applications in production, from prototype to scale Deep expertise in document understanding, information extraction, and structured content generation Experience building data pipelines that handle diverse, evolving source formats—comfortable working with messy real-world data Proficient with modern AI development stacks (LangChain, LlamaIndex) and RAG architectures Strong understanding of prompt engineering, fine-tuning, and when to use each approach Experience with knowledge representation - you've built systems that model complex domains Demonstrated ability to ship fast - you can build an MVP in days and iterate based on user feedback Fluent in AI-assisted development tools and practices - you know how to leverage AI to move faster Preferred Qualifications Deep familiarity with AI evaluation ecosystem: model benchmarks (SuperGLUE, BIG-Bench, HELM), safety evaluations (METR, Apollo), AI system card formats Experience with vendor/third-party risk assessment in any domain (InfoSec, compliance, procurement) Built multi-source aggregation systems that reconcile conflicting information and synthesize across documents Built systems that handle document understanding at scale (10K+ documents) Knowledge of ontologies, knowledge graphs, or semantic modeling Track record of automating complex manual processes using AI *Supports EST/CST/PST time zone (your choice) Compensation The expected base salary range for this position is ₹35–50L. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position in the specified location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Location & Remote Culture While this is a remote role and we're a fully distributed team, we routinely meet up in-person. We support individual members to coordinate in-person coworking whenever possible, and organize company-wide offsites multiple times a year. At Credo AI we value diversity, equity, and inclusion as core principles in our work environment, and the development of our product offerings, and we have implemented initiatives to foster and support these values. Credo AI Benefits & Perks Competitive Salary and Equity Health : We offer health, dental, and vision coverage. We also offer an ergonomic benefit to cover the costs of equipment to help staff stay healthy while working, both in the office and at home. Coworking : We will cover the cost of co-working spaces like WeWork and in-person meetups. Unlimited PTO : Credo AI has unlimited time off to support our employees Generous Parental Leave: We offer up to 12 weeks of paid parental leave. 401(k) plan for employees (US only)