Home » New Tests Show ChatGPT and Gemini Differ in Product Recommendation Performance

New Tests Show ChatGPT and Gemini Differ in Product Recommendation Performance

By

–

New Tests Show ChatGPT and Gemini Differ in Product Recommendation Performance

CITY, October 2, 2026 — New comparative tests evaluating ChatGPT and Gemini for product recommendation capabilities reveal distinct performance patterns between the two AI models, according to a recent study. The assessments focused on how each model generates suggestions across various consumer product categories, including electronics, home goods, and personal care items. Researchers measured recommendation relevance, specificity, and alignment with user intent using standardized query sets designed to mimic real-world shopping scenarios. ChatGPT demonstrated stronger performance in delivering detailed, context-aware suggestions that incorporated nuanced user preferences such as budget constraints, feature priorities, and usage scenarios. Its responses frequently included comparative analysis between products and referenced specific technical specifications. Gemini, while producing coherent and grammatically sound recommendations, tended to generate more generalized suggestions with less frequent inclusion of granular product details or side-by-side comparisons. The tests showed that ChatGPT was more likely to ask clarifying questions when faced with ambiguous queries, thereby refining its recommendations through interactive dialogue. Gemini, in contrast, often proceeded with assumptions based on common user profiles, resulting in recommendations that were broadly applicable but less personalized. Both models exhibited occasional hallucinations, such as inventing non-existent product features or misattributing specifications to incorrect brands, though these occurred at comparable rates. The evaluation did not declare an overall winner but highlighted that ChatGPT excels in depth and adaptability of recommendations, while Gemini offers consistent, safe outputs suitable for broad-audience applications. The findings are based on controlled testing environments and do not reflect real-time user interactions or commercial deployments. No specific release dates, version numbers, or pricing details for either model were included in the test methodology or results. The study contributes to ongoing efforts to benchmark AI performance in practical, consumer-facing tasks such as assisted shopping and decision support. ChatGPT, developed by OpenAI, launched in November 2022, quickly gained popularity and reached 100 million monthly active users two months after its release and 900 million weekly active users in February 2026. The chatbot has been criticized for its limitations and potential for unethical use, generating incorrect or nonsensical answers and facilitating academic dishonesty, generating misinformation, and creating malicious code. In March 2023, OpenAI added support for plugins for ChatGPT, including both plugins made by OpenAI, such as web browsing and code interpretation, and external plugins from developers such as Expedia, OpenTable, and Zapier. From October to December 2024, ChatGPT Search was deployed, allowing ChatGPT to search the web in an attempt to make more accurate and up-to-date responses. OpenAI allows businesses to tailor how their content appears in the ChatGPT Search results and influence what sources are used. In October 2025, OpenAI launched ChatGPT Atlas, a browser integrating the ChatGPT assistant directly into web navigation, to compete with existing browsers such as Google Chrome. It has an additional feature called “agentic mode” that allows it to take online actions for the user. The study’s findings underscore the ongoing evolution and competition in the AI industry, particularly in the areas of conversational AI and decision support systems.

Sources

More stories by

Most read

AI Tools

Artificial Intelligence

Business

World News