So when I tried google's Deep Research in Gemini, I ran into the same problem. It was basically a typical llm chat response, but a lot more verbose and citations to the same blogspam listicles that makes regular human research difficult.
How do I avoid this pitfall? So what I am asking is, how do I use deep research?
So if you want to do "real deep research" into some topic, then you start with the various summaries and drill down. I use Google Scholar to locate papers, then I search for the cited papers. It is tedious, but the only way that I know which avoids the pitfalls of random regurgitation of easily found materials.
Currently AGI is marketing hype. Critical thinking with real understanding, i.e. knowledge building hasn't yet been automated. You need to put in the intellectual effort.
It's a bit like a crawler, goes through papers, then follows down to other relevant papers. One advantage I see it seems to be able to search through movies as well.
But in the end you get a stack of reading materials and still have to do the work of reading them. I did try to get it to summarize them into instructions but it drops the main points.
Then in a couple months go out of business when someone tricks the AI to spill its prompt
solardev•10mo ago
It generally helps if you ask it to focus on specific kinds sources (gov sites, academic, etc.) but it really depends on the topic. Easy for some topics (the general sciences) but not so easy for other ones (popular culture stuff or current events).
muddi900•10mo ago
I guess I should have included the purpose of my research.
solardev•10mo ago
Probably a normal prompt without deep research would be better for that (but less recent), especially for topics that humans previously discussed a lot in the past (like on pre-AI reddit). Signal to noise ratio is only going to go down, down, down from here... :(
I don't think you'll get useful results from deep research in a case like this, trying to distinguish between all the contemporary advertisers and cut through the spam. Deep research is good at summarizing sources, and it works well if you can tell it what kind of trustworthy sources to focus on. It's not so good at judging the relative merit of each source. And in this case, there are no trustworthy sources... it's all just spam. If you manage to get good results out of it for market research, you should probably just start a business and become a billionaire selling that functionality instead of whatever you were researching :)