LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

QmlUWXozSFRiclA3WG9mQ0pRaTJTV3VZaXc9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Brooks' House of Bar-B-Q

All Purpose Associate Job at Brooks' House of Bar-B-Q

 ...for long periods. Ability to work irregular hours (day and night shifts). Enjoys working with people. At least 15 years of age...  ...shift, night shift, weekday and weekend shifts available) No experience required as training will be provided. Since 1951, Brooks... 

Panasonic Energy Corporation of North America

Occupational Health and Safety Manager Job at Panasonic Energy Corporation of North America

 ...Overview Do you want to join a team that's changing the world? Do you have a strong background as an Occupational Health and Safety Manager? Then we're looking for you! Check out the job description and apply now! Put your skills to meaningful use, gain unique experience... 

Wynn Las Vegas

Casino Supervisor - Table Games Job at Wynn Las Vegas

 ...Supervise a gaming area that has between one to six open gaming tables. Create player ratings with close attention to average bet, time played, and buy-in amounts. Process credit transactions (markers and RIM), fills/credits, and opening/closing of games. Assist... 

Hermeus

Site Reliability Engineer (SRE) Job at Hermeus

 ...build, and test of the company's first combined turbojet-ramjet engine and is now being scaled through its first flight vehicle...  ...capabilities to the warfighter. Hermeus is seeking a Senior Software or Site Reliability Engineer to join the Information Team and take charge of... 

Drive Time Transports

CDL A Intermodal Driver - home DAILY -5 day work week Job at Drive Time Transports

 ...CDL A Local Intermodal Driver 5 day work week - Avenel, NJ Now hiring experienced (minimum 6 months) CDL-A drivers for a high-paying...  ...and steady income Benefits available after 30 days Home Time: Every day Schedules available: Sunday - Thursday OR Tuesday...