Like any genAI model,sex, marriage, and eroticism in contemporary islamic advice literature Google Gemini responses can sometimes be inaccurate, but in this case it might be because testers don't have the expertise to fact-check them.
According to TechCrunch, the firm hired to improve accuracy for Gemini is now making its testers evaluate responses even if they don't have the "domain knowledge."
SEE ALSO: Google adds Deep Research to Gemini for browsing the web on your behalfThe report raises questions about the rigor and standards Google says it applies to testing Gemini for accuracy. In the "Building responsibly" section of the Gemini 2.0 announcement, Google said it is "working with trusted testers and external experts and performing extensive risk assessments and safety and assurance evaluations." There's a reasonable focus on evaluating responses for sensitive and harmful content, but less attention is paid to responses that aren't necessarily dangerous but just inaccurate.
Google seems to disregard the hallucination and error problem by simply adding a disclaimer that "Gemini can make mistakes, so double-check it," which effectively absolves it from any responsibility. But that doesn't account for the humans doing the work behind the scenes.
Previously GlobalLogic, a subsidiary of Hitachi, instructed its prompt engineers and analysts to skip a Gemini response they didn't fully understand. "If you do not have critical expertise (e.g. coding, math) to rate this prompt, please skip this task," said the guidelines viewed by the outlet.
But last week, GlobalLogic changed its instructions, saying, "You should not skip prompts that require specialized domain knowledge," and to instead "rate the parts of the prompt you understand," and note that they don't have the required expertise in their analysis. Expertise, in other words, is not being treated as a prerequisite for this work.
Contractors can now only skip prompts that are "completely missing information," according to TechCrunch, or those that contain sensitive content that requires a consent form.
Topics Artificial Intelligence Google
Three Cheers for Children: Mark Twain’s Toast to BabiesStaff Picks: Prince, Mary Ruefle, and Mary ShelleyLast Chance: Subscribe to The Paris Review and Lucky PeachPoem: Jean Valentine, “Birthday Letter from South Carolina”Just a Taste: The Photographer’s CookbookJust a Taste: The Photographer’s CookbookTimbuktu’s Massive Book HeistJanine di Giovanni: The Art of War ReportingListen to Djuna Barnes Read from “The Antiphon,” 1971Football: Three ImpressionsRemember When NYC Had Natural Springs? Me Either…The History of Underwear Is a Dirty HistoryTeffi: My First Visit to an Editorial OfficeBears, Abortion, Mechanical Pencils—All at the County FairExotic Pets of the Twenties and ThirtiesMy Neighbor Is Practicing “Sweet Child O’ Mine.” Help.Listen to Djuna Barnes Read from “The Antiphon,” 1971Listen to Djuna Barnes Read from “The Antiphon,” 1971Coins, Pincushions, Stagecoaches—They’ve All Starred in NovelsRichard Fariña’s “Been So Down It Looks Like Up to Me” Turns 50 Justin Bieber addresses his temper tantrum in an open letter Peak Halloween meme costume achieved with 'Babadook' clap back Who's left in the ESL 'CS:GO' Pro League finals? Lorelai, please, please, please drink less coffee in the 'Gilmore Girls' reboot Hubble telescope photo of a spooky dead star will creep you out Kelly Clarkson wigs up for a killer Halloween cover of Sia's 'Chandelier' Brexit and the U.S. election are making British children anxious Huge pile of manure dumped outside Democratic Party office in Ohio The Gods bless Australia with an epic 'world first' Marvel exhibition Parents receive anonymous letter shaming them for 'tiny' home Taipei raises rainbow flag at City Hall as thousands march in pride parade Bette Midler brought back one of her most iconic characters for Halloween John Turturro gives us the first official photo of his 'Big Lebowski' spinoff Push to record: A creator's eulogy for Vine Katy Perry dressed up as a scary good Hillary Clinton for Halloween Here's how to find your polling place — and where to eat or drink after Walking Dead recap: Season 7, Episode 2 A Cubs fan's World Series diary: On the edge of disaster Twitter ‘muted words’ feature may be one of its answers to curbing online abuse Someone hung dummies near a Trump/Pence yard sign in Florida
3.5945s , 8262.7109375 kb
Copyright © 2025 Powered by 【sex, marriage, and eroticism in contemporary islamic advice literature】,Unobstructed Information Network