Last updated: 2026-10-26
Google Vantage is an experiment from Google Research, built with New York University, that places you in conversations with an AI simulated team and returns a Skill Map. It covers three skills: creativity, collaboration and critical thinking. Access is by sign-up, and Google lists no price.
About Google Vantage
Vantage is an experiment from Google Research, developed with pedagogy researchers at New York University, that measures creativity, collaboration and critical thinking by putting you in live conversations with an AI simulated team. Standardized tests can score math or reading, but they cannot show whether a student can settle a disagreement with a teammate or defend an idea under pushback. Vantage was built to close that gap with AI-run group conversations instead of static quizzes. Google frames it as assessment infrastructure for an education that prepares students for the AI era, and its skill list follows competencies prioritized by the OECD and the World Economic Forum.
Under the hood, an Executive LLM (Gemini 2.5 Pro for collaboration tasks, Gemini 3 for creativity and critical thinking, per the Google Research blog post) generates every AI participant's lines and deliberately introduces pushback, conflicts or bottlenecks, so the human has to demonstrate the target skill instead of describing it. When the conversation ends, a Gemini 3-based AI Evaluator scores the transcript against pedagogical rubrics and returns a Skill Map with numeric scores and qualitative feedback. The vendor page names seven sub-skills: generating ideas, building on ideas, evaluating ideas, conflict resolution, project management, interpreting and analyzing, and evaluating and judging.
Missions on the vendor page include designing a science experiment, examining a journalist's sources and planning a festival. Assignment examples are grouped under science, history and community, such as "Is drinking coffee good?" for critical thinking, "Factories of the future" for creative thinking and "Raise the voting age?" for collaboration. Google says it is now testing the platform with teachers and students in schools, which makes it a classroom pilot more than a finished consumer product. If you want a tool that turns notes into study material, NotebookLM is the closer fit; for a general assistant from the same company see Gemini, and for other early Google experiments browse Google Disco and the Google Labs Playground.
In Google's validation study, 188 US-based testers aged 18 to 25 worked through 30-minute collaboration tasks, and the AI Evaluator's scores agreed with human expert raters about as closely as two human raters agree with each other. Google separately checked the creativity module with the education platform OpenMic against real high-school multimedia submissions graded by expert judges. These figures come from Google's own research write-up, not an independent audit, and this page has not re-run them.
Access is the part that changed. The vendor page now offers "Sign up for access" rather than an open start button, and the entry point moved from the Labs listing to a Google Research page. Google publishes no price and no plan list, so treat it as free to try for now, not as a promise of a free product. It is web-only and English-first, with no API, LMS integration or mobile app mentioned on the page. Who should skip it: hiring teams that need validated, employer-facing reports, and anyone who needs a guaranteed service, because an experiment from Google can change scope or disappear without the notice a paid vendor gives. To compare it with tools that fit your own job, try Smart Match or browse the directory.
Pricing
Google lists no price for Vantage on its Research page, and no paid plan has been announced. Access is by sign-up request, so availability, not cost, is the limit. Other Google experiments in the directory, such as Google Stitch, follow the same experiment pattern.
Key Features
- Executive LLM conversation steering: A single Gemini-based Executive LLM generates every AI participant's dialogue in a group task, introducing conflicts and pushback that lifted skill-relevant information yield to 92.4% on project-management conversations.
- Post-conversation AI Evaluator: A Gemini 3 evaluator reviews the completed conversation to grade demonstrated skill level, reaching a Cohen's Kappa of 0.45 to 0.64 with human expert raters.
- Visual skill map feedback: After each session, testers receive a skill map with numeric scores plus qualitative feedback instead of a single pass or fail grade.
- Creativity module validated externally: The creativity scoring module was checked against 180 real student submissions from OpenMic and matched expert judges with a 0.88 Pearson correlation.
- NYU-designed rubrics: Assessment rubrics for conflict resolution and project management were co-developed with pedagogy researchers at New York University and validated on US-based test participants.
- Sign-up access in the browser: Testers request access on Google's Vantage page and sign in with a Google account, with no software install or classroom integration mentioned.
- Seven named sub-skills: The vendor page maps three skills to seven sub-skills, from generating ideas to conflict resolution and project management, shown on the Skill Map.
Pros
- AI Evaluator scoring reached a Cohen's Kappa of up to 0.64 with human expert raters, comparable to the agreement level between two human graders.
- Creativity scoring was independently checked against 180 real high-school submissions via OpenMic and hit a 0.88 Pearson correlation with expert judges.
- Google lists no price and no paid tier on the Vantage page, so trying it costs nothing as long as you can get access.
Cons
- English-only and validated only on US-based testers aged 18 to 25, so there is no published evidence yet on how it performs with younger high schoolers or non-native English speakers.
- It's an unshipped Google Labs research experiment rather than a committed product, so Google could change scoring, add limits, or shut it down without the notice a paid vendor would give.
- Access is by sign-up request on a single Google page, and no API, LMS integration or mobile app is mentioned, so it cannot yet be rolled out to a class by an admin.
Frequently Asked Questions
Does Google Vantage have a price?
Google lists no price on the Vantage page and has announced no paid plan, so it is free to try for now. The limit is availability: the page asks you to sign up for access, and Google has published no usage caps or commercial roadmap.
How do you get access to Google Vantage?
Open the Vantage page, which the old labs.google/vantage address redirects to, and choose Sign up for access. You sign in with a Google account, then work through a mission with an AI simulated team and receive a Skill Map at the end. Google does not say how quickly access is granted.
Which skills does Google Vantage measure?
Three: creative thinking, collaboration and critical thinking. The Skill Map breaks them into seven sub-skills, with idea generation at one end and project management at the other. Missions range from designing a science experiment to planning a festival.
What are alternatives to Google Vantage?
TestGorilla and CodeSignal are employer-facing assessment platforms, and Khan Academy's Khanmigo is a student tutor. None is a free research experiment that scores teamwork against AI teammates. Choose Vantage to practice or study durable skills, and an employer platform if you need hiring reports.
Is Google Vantage a finished product?
No. The page labels it an experiment from Google Research and says Google is testing it with teachers and students. Scoring, access rules and availability can change, and the validation figures in this profile come from Google's own research write-up.
HokAI guides covering Google Vantage
- What Google Vantage Is Actually For: Google Vantage grades a student's collaboration and creativity by scoring an AI-run group conversation against a rubric, and here is who it is not for.
- Best AI Quiz Generators in 2026: Alice, Jotform, Lessonsquill and ImaginAi compared for turning notes into quizzes, with exact free-tier caps and who should skip document-to-quiz tools.