Real Estate Agent (PART TIME)

Title - Annotation Lead

Location - Los Angeles, CA (Remote)

Duration - 6 months contract

Job Description -

Job Overview

We are seeking experienced real estate professionals to support AI and Machine Learning initiatives focused on improving real estate transaction experiences. This is a remote contract opportunity ideal for licensed real estate agents or brokers seeking additional income while contributing to cutting-edge Artificial Intelligence projects.

Work schedules will generally align with 9:00 AM – 5:00 PM PST (plus lunch as needed), though hours, days, and project duration may vary based on business requirements. Assignments may last a few days at a time, with opportunities for recurring work on future projects.

Note.

About the Team

Artificial Intelligence (AI) and Machine Learning (ML) are central to the organization’s products and services, including automated home recommendations, conversational AI experiences, and intelligent real estate transaction tools.

The AI Platform team develops Large Language Model (LLM) and multimodal AI solutions that enhance customer experiences across real estate services. This role works closely with AI researchers, ML engineers, data scientists, software developers, and operations teams to improve AI-powered conversational and search experiences.

Position Summary

The Annotation Judge plays a critical role in evaluating, reviewing, and improving AI-generated interactions and annotations related to real estate conversations and customer experiences.

This position combines deep real estate expertise with strong analytical and language evaluation skills. The ideal candidate is detail-oriented, highly collaborative, and naturally curious about Artificial Intelligence and language subtleties.

Projects may include:

Evaluating AI-generated chatbot responses

Reviewing automatically annotated conversations

Assessing search result relevance and user query understanding

Supporting AI model training and calibration efforts

Helping define annotation guidelines and quality standards

Key Responsibilities

Review and evaluate annotated datasets to ensure quality and accuracy

Provide detailed feedback to engineers and AI teams to improve model performance

Collaborate with Data Scientists, ML Engineers, and Operations teams

Develop and maintain annotation guidelines and best practices

Help establish Ground Truth datasets for AI training

Contribute examples and recommendations for training content

Identify gaps in existing training materials and suggest improvements

Ensure consistency and clarity for annotation processes used by global teams

Minimum Qualifications

Minimum 3+ years of active experience as a licensed Real Estate Agent or Broker

Strong understanding of the real estate transaction lifecycle

Demonstrated interest in Artificial Intelligence and AI-generated content evaluation

Bachelor’s degree in English, Linguistics, or a related field

Experience with Natural Language Processing (NLP), transcription, localization, or translation projects

Excellent analytical and attention-to-detail skills

Strong communication and collaboration abilities

Experience using NLP annotation or evaluation tools is a plus

Preferred Qualifications

Experience with copywriting, UX writing, or brand/content guideline development

Experience with:

Machine-generated speech evaluation

Search result evaluation

Search query categorization

Conversational AI analysis

Ability to manage complex processes independently and within team environments