Technical Program Manager, Data at People.ai
Kyiv, UA
People.ai accelerates enterprise growth through the power of AI. With the industry’s only Revenue Intelligence System, People.ai frees all customer-facing teams, including salesmarketing, and customer success, from manual data entry by automatically capturing all contact and customer activity data, dynamically updating CRM and other systems of record, and providing actionable intelligence across management tools to realize the full selling capacity of the enterprise. Some of the world’s best brands are leveraging People.ai to transform their business, including Lyft, New Relic, Okta, Tanium, and Zoom.
 
At People.ai, we believe that people enrich the world around them in countless ways. We believe that the more time they spend applying their creativity, resourcefulness and critical thinking to activities that matter most in their professional life, the more effective a professional they become. We're developing a deep understanding of the professional world, mapping people, companies, and the information that flows between them through natural language processing and machine learning. Our team is a diverse, outspoken group of creatives and critical thinkers, hyper-focused on driving enterprise growth. We embrace different. We applaud non-traditional career paths. We're inspired by people who have made processes their own. 
 
 
The Technical Program Manager, Data will own and drive project management relating to investments in size and quality of People Graph, including human evaluation at scale for measurement and model training. Tasks include: data set acquisition/generation, vendor selection and engagement, acting as the process flywheel, and flagging issues and risks as they arise. This role is a critical component to establishing People.ai as a data-first company. The output of this role feeds into the team’s goal in sustained net new revenue

Responsibilities

 

      • Establish a human annotation process at People.ai, combining the services of internal annotators with those of external annotation vendors
      • Act as the process flywheel to ensure evaluation tasks are prioritized, loaded, and worked on; drive evaluation quality and throughput
      • Foster a partnership with Eng/DS/Product teams to act as an expert on the costs, time estimates, tradeoffs, complexities, limitations, etc. of annotation.
      • Define guidelines and user interfaces for human evaluation tasks in close collaboration with the Product team
      • In close collaboration with internal and external resources, monitor and report on the quality of the data generated through the human annotation process
      • Conduct vendor evaluations; provide ongoing recommendations to the Product team for the human evaluation vendor and platform of choice
      • Generate data sets for measurement and experimentation; source external data as required
      • Manage the human evaluation budget
 

Requirements

 

    • Strong people skills; seamlessly work across disciplines
    • Built long-lasting relationships with external parties to guide the future direction of human evaluation
    • Some experience with contract negotiation, security controls.
    • Strong technical aptitude, with experience and knowledge of training data generation for machine learning purposes. 
    • Experience with a range of common data and file formats, general knowledge of AWS ecosystem
    • Experience performing annotations and developing reference “golden” datasets
    • Oozes comfort and confidence with data, especially in the face of disparate data sets
    • Experience handling and managing content with sensitive data containing PII (personally identifiable information).
    • Ability to break down complex tasks for consumption by a diverse, not immediately technical audience
Founded in 2016 and based in San Francisco, the company is backed by ICONIQ Capital, Andreessen Horowitz, Lightspeed Venture Partners, Y Combinator and others. In 2019, People.ai was recognized as a winner of the 2019 Bay Area Best Places To Work, an awards program presented by the San Francisco Business Times and the Silicon Valley Business Journal.