B. The Remedy Should Prevent Google from Extending Its Monopolies into Query-Based AI Tools.
Good luck with that YC...
Nor has Netflix had a monopoly on streaming.
It looks like this is a strategic case to prevent Google from getting into AI search space and even gain access to their search index data so that they can train their own models on it.
Wright brothers invited the aircraft but almost all their patents were cancelled when the Great War started. If we believe the AI race is indeed an existential threat then let's cancel all patents that prevent anyone from innovating.
1) Eliminate Google Play Services for android and the oem non-compete deals.
2) Right to privacy. All data collection and storage (even on customer owned hardware if used for targeting decisions) must be opt-in, by purpose and annually renewed. It must be easier to only opt in to data collection for use cases that provide application functionality / business transactions than it is to opt into blanket data collection.
I wonder why a VC firm who is quite heavily invested in AI based startups file an amicus brief like that…
Edit: before this gets downvoted into oblivion, the comment is not against antitrust enforcement. It’s about VC firms having very specific ideas about what the antitrust enforcement would look like.
Google and the rest of big tech are like the Jupiter of the tech world. It clears the orbit of anything else that could form.
Big tech is so big that it can jump into new markets with ease, kill incumbents, snuff out new players, and perpetually tax non-innovation.
We're twenty years behind on antitrust and breakups. It's time we had a forest fire to make way for new growth.
That’s why everything’s so insanely consolidated now. Practically every market has a handful of massive players all of which would currently be under serious threat of break-up under the old approach to enforcement. It’s all monopoly.
https://medium.com/@kazeemibrahim18/the-post-ipo-performance...
> In aggregate, the average return across these YC companies is -49%, with a median return of -46%. To put this into perspective, over the same period, the S&P 500 yielded a positive return of 58%
And for the rest of the companies, they aren’t trying to compete with BigTech, they are trying to get acquired by them. Out of the literally thousands of companies that YC has invested in, only about two dozen have gone public
The end game for these unicorns is to become the cash hoard that they intended to compete with.
I'm fine with that. Let them make money at the expense of big tech.
Breaking up big tech benefits financial/venture capital, but it also benefits labor capital as well. More opportunity for more startups to succeed, more competition for engineering talent, less market distorting wage collusion.
Big tech already won. It's benefactors already reap the benefits. Break them up and a new generation of engineers can grow wealthy on the field they contribute their labor to.
Right now the proceeds of tech go to hedge funds and pension funds. It's venture capital and entrepreneurs that take risks. They're the ones that should see upside. Unfortunately, big tech monopolies put a ceiling on this.
So if Google wasn’t a “monopoly” you think a startup could make a better search engine? Be more popular than Android - Microsoft tried both and failed because people prefer Google products. It wasn’t for the lack of money.
And engineers are getting wealthy - by working for BigTech. Even an entry level developer at BigTech makes more than 90% of workers.
There, FTFY. It was implied, was it not?
Perhaps that is what should happen here, but let's not quibble about it.
They're looking for free data for their AI startups to make money off of, and with Google being in the middle of an antitrust catastrophe that may very well collapse web browser variety to two options in the next years, there's a lot of money to be made by stoking the flames.
If I give you only one reasonable option and you choose that, is that selection? What if this one option distinguished others?
And no - some people didn't willingly and consciously switched to their search engine. It was pushed down their throats by browser vendors being paid-off by Google for setting it as the default one. Mozilla has overwritten user-changed search engine setting in Firefox with several updates.
Non tech-savvy users simply accept changes made in software they use.
"Engines like Bing" is an ambiguous term. There are better options than Bing.
They have indeed invested tons in r&d, but with excessively little results. Besides web search it's tough to see succeses that Google didn't buy their way into. Gmail, maps, ... maybe?
I'm really glad that YC brought this against Google but it should be clear that YC also enabled them. It's a lie that YC is independent from Google as it partners and promotes their engineers and Big Tech allies. They see the writing on the wall and their lawyers see this as a hedge against lawsuits against them. "We didn't cause this mess, see look! We're trying to help!" YC also doesn't serve American startups at all and their entrepreneurs strongly favors California or India.
Keep in mind that if paying to be the default search engine in a browser is illegal, then Firefox's primary revenue source is out the window.
By having search monopolies, they've gamified paying for placement above your competitor's trademarks. Rather than spend on engineering or lowering costs, you have to pay to defend your brand.
There are thousands of ways these monopolies are horrible for the consumer, for small business, and for innovation.
These companies force their way into new markets, kill the sustainable incumbents by give away services sustained on unrelated business unit profit, then raise rates once the field has been salted and acquired. Amazon is a grocery store, primary care doctor, home electronics company, and James Bond.
Why should Amazon get free advertising for their films on their web storefront, plastered on the side of their delivery vans, emblazoned on their packaging, when competing studios have to spend millions on marketing? To top it off, they're outsourcing the film crew labor to Eastern Europe where there are no crew safety laws and are putting American film workers out of business.
And the current price pressure on your salary is directly a result of their market power. They don't have to fear you starting a company that can impact their profits anymore.
These companies should all be dismantled. Large companies should be exposed to evolutionary pressures, but because of monopoly they become invasive species and dominate entire ecosystems. Regulation is the path to healthy competition and innovation.
We have sandboxing, permissions, app scanning heuristics, and databases of bad apps. If the web works from a technical standpoint and security posture, so can native.
I would love to know how much money Google makes just from this extortion.
… which is enabled by their intentionally-misleading search ads, which also enable scams. I’d further love to know how much money they make promoting scams.
Huawei even sells phones without Google Play in the west! Of course the first thing people try to do on them is get Google Play working, because the cheap hardware is all people care about.
Sure, Apple has proven to be pretty shit about app cost, but Android does and always has offered alternative app stores, and it's the leading example of how much companies like Epic are lying through their teeth.
Consumers pay the 30% app tax on Android because the companies claiming to want to get rid of it don't actually want to invest in alternatives, they just want Apple and Google to host their games for free so they can make more money.
The same goes for a lot of these monopolies. People want options, but they don't want to pay for options. The result is a quick race to the bottom where only a few high-profit, low-margin companies dominate the market.
It is not about price. It is about platforms. A 0% app tax could not compete if there is 0 users on the platform, and google could increase the app tax to 100% if they wanted and people would still use it.
UPS and FedEx don't emblazon ads on their delivery trucks. Nobody is buying up those ad spaces.
If I need my phone to access my bank and my bank's app only works on official Android or iOS then that's it. I don't have a choice in what phone OS I'm running.
And the bank most likely does that because of government regulations.
> This should be zero if there was unlimited competition or web installation
Is credit card processing, billing, storage, distribution, “free?”
And the 30% figure is inaccurate. Most developers don’t pay that.
How about stripe charging 2.9% +$0.30 per transaction? They are almost double the actual cost of the interchanges.
Google and Apple charge an order of magnitude more for a straightjacket distribution mechanism that is inferior to web search.
This part reads like a suggestion to loosen anti-competitive/antitrust law.
> Just like we don't fine everyone with a car for speeding
can me mistaken for "not everyone who is speeding is fined", and that's clearly not what you meant or wrote. You are right its not more like tolls because it still doesn't capture the /exponential/ difference of whats being compared (any other company vs google). Its like a car vs a jet fighter
The company that brought us AirBnB and Doordash arguing for fair and open markets should say enough about how honest their intentions are.
Just as an example: in my country, all public transit information is shared publicly between operators, so anyone can effectively build a public transit navigation app. That includes the for-profit companies that actually run the trains. Had they kept their data silo'd up, like they were not that long ago, companies would need to make expensive deals or write elaborate scrapers to provide basic route navigation services. Thanks to regulation opening up the data for this system, everyone benefits, including the transit companies themselves, as their route planners now seemlessly integrate with routes offered by unrelated third parties.
By only hitting Google with regulations like those, I think we're building a situation where it's only a matter of time before a new Google appears and ruins the market again. Google has been financing Firefox and Safari for years now because they don't want to be the only browser, because being the only browser comes with all kinds of nasty antitrust regulations. If we selectively apply mitigations like these for competitive purposes (which I very much doubt are the real reason they're being suggested anyway), we'll just end up with some equivalent like "OpenAI sponsoring xAI and Claude so OpenAI doesn't control more than 80% of market share".
A court can't really formulate and enact such a remedy.
all public transit information
Not all entities are public and we have more readily available methods to influence the ones that are.
Google should not be punished for having gained a near-monopoly by hiring the best people.
But perhaps their near-monopoly is due to other reasons like paying large amounts to ensure that they are the default option on various platforms. In this case, legal restrictions might be more appropriate.
How do we determine which of these proposed reasons for the near-monopoly is correct? We use a legal process where each side presents their evidence and a neutral party decides which is most credible.
It is nothing to do with "hiring the best people". Google's exec-level leadership is extremely poor, Mr Magoo-tier management. This is largely due to their share classes, the people at the very top are not very good at business so Google largely isn't run like a business. They have one business that is probably worth $4-5tn, and the rest is worth -$3-4tn. The number of "best people" out there is usually under 500 in a country the size of the US, a country that has hundreds of thousands of employees is not hiring the best.
I would guess under 100 people at Google actually positively impact financial results in any way because the advertising business grows rapidly, uses no capital, and requires no staff. This is true of many of the tech companies do, you aren't getting the best if you pay an exec $50m because the best will always do their own thing and make more. Rather you get someone like Pichai or Cook who sounds good and will get shareholders to believe that setting fire to $200m/year to pay them is a good idea, they are indistinguishable from politicians.
Google is under-earning massively. Staff aren't a monopoly, you just pay someone to leave and they are yours now (you see this in other areas like HFT where staff actually know useful stuff, you don't see this in tech because most staff don't know anything, they are looking for drones).
They start with a page with zero ads, they add one ad to that page one year, ad sales pushes that placements, then a few years they do it again, etc. Meta are the same.
Google do sell at a higher price than offline ads because of targeting/intent but this is inherent to the product: search has inherently better intent and their targeting tech is no better than anyone else such that their prices are higher/grow faster.
That is their growth model: higher ad density, the CEO deciding to add another ad to a page and earning $100m/year. There is no value-added otherwise because you don't need many people, you don't need capital and you are making $300bn/year.
And, again, if you own the shares you understand that you are getting the ads business, and because of the dual class you are also getting this tech bureaucracy that sets fire to tens of billions every year employing people to do nothing. If these people are so productive...where is the revenue? It is all ads or ancillary business, they have GCP now but there is nothing else...because these people aren't doing anything.
It is like owning a business that turns lead into gold, the process is automatic, requires no capital...and then employing a bunch of monks to pray for the lead and saying the business couldn't exist without them. Lol.
[0] https://www.seroundtable.com/google-search-user-interaction-...
I’m guessing this whole court case wouldn’t have been a thing if Google wasn’t bribing Apple, to the tune of $20 billion a year [1], to remain the default search engine on iOS.
1: https://www.searchenginejournal.com/apple-may-add-ai-search-...
Had Google operated like a normal company, the risk/reward of this kind of research would've looked completely differently.
Google's monopoly helped research along in the same way totalitarian countries like China are developing infrastructure at break-neck speed: if you don't need to care about pesky rights and regulations, you can do things that would otherwise be impossible.
I don't think Google's monopoly is worth having the current generation of lie generator bots around, but I don't think generative AI would be where it is right now had Google been forced to comply with antitrust regulations ten years ago.
I would rather we don’t allow monopolies since they are so bad for society, regardless of some benefits.
Government funded research and private investment are still a thing, that doesn’t try to break the whole capitalism thing.
I've heard this argument before (and recognize that you aren't defending it), but telecommunications, network and technology innovation has hardly suffered since Bell was dismantled in 1982.
Fiber rollout in countries where a government funded phone line rollout has already succeeded is laughably slow, taking decades and many billions with little to show for it. Even in countries where no phone lines were rolled out back in the day, fiber is more and more being skipped as 5G allows for cheaper (though less reliable and less capable) deployment.
I'm not saying monopolies are good or anything, and I think our problems would be even worse had we stuck to the monopolist systems that brought us telecoms as we know it, but I wouldn't consider the industry one where there's enough competition to drive innovation, especially since at least half of the entire sector is competing against Chinese government-controlled companies with seemingly endless coffers.
And yet, waymo seems to have got the correct risk reward trade-off compared to all of the move-fast-and-get-banned competitors...
I'd argue the fact that Google publishes much more of their research than their competitors do is a strong indicator that they're actually not the anti-competitive ones.
I think there are many good reasons to pursue anti-trust action against companies that are in a dominant market position, but we should be honest about the tradeoffs. Businesses that have to aggressively compete to maintain market share don't have the slack to fund basic research.
It should be at, or partnered with, higher learning institutions and since it's public funded all of the results should be free to use*. I'm willing to entertain the idea of: Free use for people and corporations within the country/countries that funded research, everyone else pays compulsory license fees.
Though both companies created novel & useful inventions, the biggest shifts in those industries during those monopoly eras were from outside those organisations by competitive startups. As an example, IBM should have produced Microsoft, but they didn't. They missed out on a multi-trillion dollar value creation opportunity as a result.
I have been close enough to billionaires and how they spend their money to not be fully impressed by such arguments.
And certainly the robber barons of the 2000s spend far less on the public good than when tax rates were higher and they used to fund universities, libraries, hospitals and the like.
Google's entire business model is currently under threat right now.
The software world was basically created by Xerox and AT&T research.
OpenAI is the reason for the current AI boom. Google wasn't productizing anything and didn't put any of this stuff out in the open. Where was their productization of the transformer?
If anything, it should show that Google malinvests. Maybe none of it would have seen the light of day. Only now that they've been threatened are they building products.
This is about concurrent with OpenAI's release of GPT-2. But GPT-2 was not really a product.
Then AT&T was shut down and Bell Labs went away.
If we take your argument seriously then AT&T shouldn’t have been dismantled. But it was a good thing AT&T was dismantled. It helped lead to the modern internet.
By your logic all Rockefeller had to do in the early 20th century was set up a lab to do basic research and then Standard Oil wouldn’t have been broken up.
Monopolies should be broken up. This is true regardless of any basic research that they fund.
They are disliked now as much as they were disliked then. Except back then they charged you a hell of a lot for long distance.
Citation needed. I hear this repeated, but the consumer experience was it was split into regional monopolies, and consumers now had to deal with both local and long distance, and both were still monopolies. It only got better with competition from mobile providers.
https://www.investopedia.com/ask/answers/09/att-breakup-spin...
Suprisingly there’s an archived DoJ page that says that the same remedies may have been much cheaper to achieve through other means.
https://www.justice.gov/archives/atr/att-divestiture-was-it-...
YMMV. I don’t agree with the narrowness of this analysis, and would like to see some links to academic studies in economics and the study of innovation tbh.
But it's easy to imagine a world where that didn't happen and BSD was just killed dead. So no OS X, no iOS, no Android, no ChromeOS, and the only vendor able to stand on its own is the one we all agree had the worst product.
Ironically the world where the Bell monopoly was left in place seems to me to be one where we're all stuck running Microsoft Windows on everything, no?
I mean, fine, there's nuance to everything but the idea that "well, open research isn't so important" seems frankly batshit to me. Monopolies fall on their own all the time (Microsoft's did too!). You can't get stuff into the public space that wasn't ever there to begin with.
What in the heck are you talking about??? After Microsoft was convicted, even though they never received any actual punishment, the were very internally cautions about any behaviors that could be perceived as monopolistic. This is like a total misinterpretation of what actually occurred on your part.
And yes, monopolies do fall, after very long periods of time. Some monopoly sitting around 25 years may not seem like much, but that's half an average persons working life.
Nevertheless anti-Trust law exists because of the belief that monopolies should not exist and that it is the governments function to dismantle monopolies. The consequence of that is that corporations who can freely spend hundreds of millions on basic research will be dismantled as well, as happened with AT&T, and the funding for the basic research will cease.
>YC is arguing that their incentive for funding that basic research should be taken away in order to spur innovation?
No. That is the stance of the government. YC is arguing that the remedies the government is seeking are appropriate.
FTFY
Without Google the researchers who invented the Transformers model might have launched their own startup instead of sitting on the technology for 5 years while it's mismanaged at a big company. We would have had LLMs in 2018 not 2022.
one could argue that transformers are nothing without attention layer, which was not invented at google.
Ma Bell is arguing that Bell labs has been a fountain of knowledge everyone admires and has contributed tremendously to the advancement of telecommunication systems.
Amicus curiae (friend of the court) brief is being submitted by Y Combinator to pile on the US vs Google anti-trust case.
YC asks court to basically cripple Google in their Search, Advertising and AI endeavours:
- Open access to Google's datasets and search index.
- Restrict Google's expansion into AI through monopolistic practices.
- Limit Google exclusive agreements and pay-to-play distribution deals.
- Enforce anti-circumvention and anti-retaliation mechanisms.
IMO, from a VC standpoint, it's in YC's interest to give their privately funded startups the best chance possible to thrive. If that includes destroying solid giants of the industry, so be it.
Seems like the court system may not be the best way to compete
What do you mean by this and how will it happen?
Democratic software means three things:
1. Can you understand it
2. Can you influence it both now and after your death
3. Can you destroy it
I don’t see how any of these things apply to AI, I’m sure it will make some people incredibly wealthy at the expense of others.
Not a single person in this entire ecosystem knows the difference between democratize and liberalize. Hint: AI isn't gonna let us vote on aspects of search.
In search (the relevant market here), Microsoft does compete in the marketplace, and Microsoft's evidence that Google's anticompetitive practices have prevented them from gaining any meaningful ground in search were a keystone of the government's case, including the fact that Microsoft has invested nearly $100 billion into Bing [1].
In adtech much the same can be said about Meta.
So, again, I'm curious: in which market does Google not have competitors spending massive amounts of cash which Google still manages to hold back from being able to meaningfully compete?
[0] https://storage.courtlistener.com/recap/gov.uscourts.dcd.223...
[1] https://storage.courtlistener.com/recap/gov.uscourts.dcd.223...
For example, from the second filing I linked to:
> After search began appearing on phones, Google started logging information about user location, swipes, and other user-related movements. PFOF ¶¶ 1003–1004. This data is now vital to every aspect of search, including figuring out where and when to crawl specific websites, how to index the information retrieved from that crawl, what documents to retrieve from the index in response to a user query, and how to rank the retrieved items. Some elements of Google’s search engine are trained on 13 months of data—a volume that would take Bing over 17 years to accumulate.
You're not entitled to a business model if your business model is harmful.
What exactly do you think is stopping you from using a competitor? Can you not find the setting to change your default search engine in Chrome? Is Google blocking you from making that choice somehow? All the arguments I've seen for Google being anti-competitive in this sector are extremely weak.
They compete much like I compete for People’s Most Beautiful Man in the World :)
Google is being competitive.
YC is being anti-competitive.
Because they suck at competing against Google and they want to get unfair, unethical advantage themselves.
Imagine spending years and billions building something and then I show up and say “hey man that’s not fair, give me a slice of that thing for free. Oh and also I’m probably going to sell it back to you someday for a lot of money”.
And before someone tells me “that’s the law”, I don’t care. If that’s the law then it should be changed. Laws have been written (and lobbied) for all sorts of reasons and surprisingly not all of them are fair and ethical.
Standard Oil is being competitive.
The U.S. oil refining and distribution industry is being anti-competitive.
Because they suck at competing against Standard Oil and they want to get unfair, unethical advantage themselves.
Imagine spending years and billions building something and then I show up and say “hey man that’s not fair, give me a slice of that thing”.
And before someone tells me “that’s the Sherman Act”, I don’t care. If that’s the law then it should be changed. Laws have been written (and lobbied) for all sorts of reasons and surprisingly not all of them are fair and ethical.
(I hope this illustrates how easy it is to make this exact argument about literally any monopoly.)
So pretty much "We don't want google to develop new things, we want them to have buy those from us"
The thing is, Google doesn't develop anything new. Everything new they make fails horribly, so they can't and don't compete with YC in the way that you think.
Examples of failed Google homegrown technologies include:
- Social media: Google Buzz, Google+
- Messaging: Google Chat, Hangouts, actually there's too many to list
- Video: Google Video
Almost all of Google's successful products are acquisitions:
- Homegrown: Search, Gmail
- Acquisitions: YouTube, Analytics, most of their adtech stack, Android, DeepBrain (the people who did all the AI work at Google)
Furthermore, whenever Google or Facebook buys any startup, that startup gets an immediate moat and capital injection that can be used to crush any other startup that didn't sell out fast enough. So YC only has one option for an exit: sell the company to Google at a price Google decides.
Gemini (the app, not the API or AI studio) is one of the few places where we can use frontier generative AI without a “customer noncompete” (you know, the one where they compete with us and then say we’re not allowed to compete back) … if you use Claude or OpenAI or Grok, you’re prohibited from training on your chat logs, or even using the thing to develop AI. Not so with Gemini app.
Too bad you have to lose your chat history just to deactivate model training (“Gemini apps activity” conflates opt-out of training with opt-out of storing chat history)
I don’t know much about the ads space but I just hope going after Google doesn’t create a vacuum that gets filled by an even worse monopoly (OpenAI)
There has been no time in human history where destroying monopolies were a bad thing.
Just because OpenAI isn’t in “extraction mode” yet doesn’t mean it’s not a scary monopoly.
Source, figure 2 in: [1] https://iot-analytics.com/leading-generative-ai-companies/
Is there anything he could have done to avoid this outcome? In a way that Google shareholders would have found acceptable?
Or was this outcome inevitable?
Unlike Microsoft's antitrust case of the 90s, Google seems much less anti-competitive by nature. Sure, they have unprecedented scale in search... but even that hegemony is being threatened by others in AI.
If anything, going after Google with a DoJ kludgel will cause a servere freeze on startup M&A across all of FAANG. With IPO windows (mostly) closed, this removes the biggest exit dynamic the startup ecosystem has at its disposal. This is not a good thing from my perspective, and would seem counter to YC's interests.
Someone steelman this for me...?
It seems much less, but I don't believe it is much less anticompetitive. We're talking about the search market specifically in this case, and the government has presented strong evidence that Google is:
* Using its position in other markets (browser, mobile) to ensure that others can't compete in search.
* Paying the major other vendors in those markets (browser, mobile) enormous sums of money to ensure that ~100% of the market share in both markets is used to prop up their lead in search.
Both of these things are pretty blatantly anticompetitive: they're competing not primarily based on the quality of their product offering but instead based on their pre-existing revenue streams and their leads in other markets.
Startups ideally should compete on merit, not on whether they are eventually allowed access to Google’s platforms or get acquired. Startups can still exit via IPO, PE acquisition, cross-industry buyers or M&A.
From this POV, Google’s control over the adtech stack may be seen as gatekeeping digital advertising, which many YC companies rely on.
The use money and Google Play services to hinder competition.
Not really less anti-competitive.
You pay a lawyer a few thousand bucks to write some populist bromides you get to slap your name in the news. Seems like a good ROI.
it won't. My bet is that bing and some other indexes are 95% Ok for average Joe. But relevance ranking is much tougher problem, and "google.com" is household brand with many other functions(maps, news, stocks, weather, knowledge graph, shopping, videos), and that's what is foundation of google monopoly.
I think this shared index thing will actually kill competition even more, since every players will use only index owned by google now.
It makes sense to break that out so everyone has access to the same dataset at FRAND pricing.
My heart just wants Google to burn to the ground, but my brain says this is the more reasonable approach.
Thus being even slightly in front of others is reinforced and the gap only widens.
How so?
A caching proxy costs you almost nothing and will serve thousands of requests per second on ancient hardware. Actually there's never been a better time in the history of the Internet to have competing search engines since there's never been so much abundance of performance, bandwidth, and software available at historic low prices or for free.
This isn't a "natural" monopoly, it's more like Internet Explorer 6.0 and everyone designing their sites to use ActiveX and IE-specific quirks.
There are so many other bots/scrapers out there that literally return zero that I don’t blame site owners for blocking all bots except googlebot.
Would it be nice if they also allowed altruist-bot or common-crawler-bot? Maybe, but that’s their call and a lot of them have made it on a rational basis.
* - or is perceived to return
This is similar to the natural monopoly of root DNS servers (managed as a public good). There is no reason more money couldn't go into either Common Crawl, or something like it. The Internet Archive can persist the data for ~$2/GB in perpetuity (although storing it elsewhere is also fine imho) as the storage system of last resort. How you provide access to this data is, I argue, similar to how access to science datasets is provided by custodian institutions (examples would be NOAA, CERN, etc).
Build foundations on public goods, very broadly speaking (think OSI model, but for entire systems). This helps society avoid the grasp of Big Tech and their endless desire to build moats for value capture.
No they can't but do you have a source?
> We estimate that permanent storage costs us approximately $2.00US per gigabyte.
https://webservices.archive.org/pages/vault/
> Vault offers a low-cost pricing model based on a one-time price per-gigabyte/terabyte for data deposited in the system, with no additional annual storage fees or data egress costs.
https://blog.dshr.org/2017/08/economic-model-of-long-term-st...
I agree that each front end should do it, but you can bet it will be a core service.
One web forum I regularly read went through a patch a few months ago where it was unavailable for about 90% of the time due to being hammered by crawlers. It's only up again now because the owner managed to find a way to block them that hasn't yet been circumvented.
So it's easy to see why people would allow googlebot and little else.
We routinely are fighting off hundreds of bots at any moment. Thousands and Thousands per day, easily. US, China, Brazil from hundreds of different IPs, dozens of different (and falsified!) user agents all ignoring robots.txt and pushing over services that are needed by human beings trying to get work done.
EDIT: Just checked our anubis stats for the last 24h
CHALLENGE: 829,586
DENY: 621,462
ALLOW: 96,810
This is with a pretty aggressive "DENY" rule for a lot of the AI related bots and on 2 pretty small sites at $JOB. We have hundreds, if not thousands of different sites that aren't protected by Anubis (yet).
Anubis and efforts like it are a xesend for companies that don't want to pay off Cloudflare or some other "security" company peddling a WAF.
I think it's also important to highlight that sites explicitly choose which bots to allow in their robots.txt files, prioritizing Google which reinforces its position as the de-facto monopoly. Even when other bots are technically able to crawl them.
Why not also require Apple to split off only the phone and messaging part of its iPhone, Meta to split off only the user feed data, and for the U.S. federal government to run only out of Washington D.C.?
This isn’t the breakup of AT&T in the early 1980s where you could say all the equipment and wiring just now belongs to separate entities. (It wasn’t that simple, but it wasn’t like trying to extract an organ.)
I think people have to understand that and know that what they’re doing is killing Google, and it was already on its way into mind-numbed enterprise territory.
Ooh, can we? My wife is super jealous of my ability to install custom apps for phone calls and messaging on Android, it'd be great if Apple would open theirs up to competition. Competition in the SMS app space would also likely help break up the usage of iMessage as a tool to pressure people into getting an iPhone so they get the blue bubble.
Now antitrust means punishing companies that are too good. Their product is too superior. Even though Windows, the most used computer OS, literally defaults bing search but consumers change it to google. They are choosing to use google. We're going to punish the company that makes a product so good users don't want to use other products. They clearly have choice. There is no switching cost to what search engine you use. Its sad when companies who can't make a product people that people't don't want to use instead to use regulatory capture to prevent real competition in the search engine market. Just make a better product.
This isn’t about search, it’s about their ad monopoly. They are not being punished for search or related products. I’m actually not sure how breaking out the search index helps in this situation. I would think splitting out off-Google advertising is the more obvious break and one that would benefit humanity. (Ad networks can die in a fire.)
Ad is even worse as Google doesn’t even control the majority of digital marketing market. Only case i can think of is the Amex case but Supreme Court rightly found you can’t be an abusive monopoly and have less than a majority of the market.
At every company I've been at, half the dependencies came from big tech, and more than half of those were built and maintained by google. bazel, kubernetes, test frameworks, tensorflow, etc. these are just the big ones. There are a lot of smaller libraries from google that we've used too, and more still that aren't owned by google but they invest a lot of engineering time into.
I don't know what the right answer is to the google of today, but the cavalier assumption that google has simply leveraged a monopoly in search to build everything else it has doesn't add up to me.
Heck, they can't even be bothered to fund a single developer to help their hardware run Linux.
As an european, I am happy to see that the US administration may be ready to kill the one of the most powerful and unassailable company in the world and allow any other country to build a replacement.
People, clean that shit up before publishing. That's an embarrassment. At least it's not "FINAL FINAL2 REWORKED" or something equally grotesque.
Paid competitors cannot compete because people won't pay. People want the death of Google because people hate ads and tracking.
Ultimately it is an everyone loses situation. No one is going to fly in a replace Google without either 1.) Charging a monthly sub or 2.) Invasive (yet most profitable) ad tracking.
This is exactly why youtube stands alone too. What company looks at youtube's userbase and says "Yes, I want to cater to people who despise subscriptions and block ads". Exactly what vid.me did in 2017, which everyone celebrated until the went bankrupt.
the_duke•3h ago
> "Our experience has been that entrenched monopoly power often deters new entry and chills investment in disruptive innovation."
> "independent venture-capital firms like YC often hesitate to fund startups in the “kill zone” —the area of deadened innovation around a monopolist like Google."
> "We agree with Plaintiffs' proposal that the remedy package should create pathways for startups and innovators to access Google's monopoly-derived datasets and search index."
> "The remedy order should also prevent Google from entering into exclusive agreements to access AI training data..."
> "An effective remedy package should help to leverage the current moment by ensuring that next-generation search and query-based AI tools can reach users free from exclusion, interference, or cooption."
> "the remedy package should prevent Google from anticompetitive self-preferencing, and this prohibition should apply specifically to Google's use of its monopoly search product to boost its query-based AI tools or discriminate against rivals' tools."
I think they have a good point with AI. After lagging behind initially, Google really went at it hard. Gemini is great now, and they are building a good set of tooling.
It's easy for Google to suffocate the startups in that area. They already have a massive advantage with all the data they are sitting on.
NitpickLawyer•2h ago
> It's easy for Google to suffocate the startups in that area. They already have a massive advantage with all the data they are sitting on.
What is the solution, though? Should they not be allowed to compete in the LLM + search space? Should they handicap their models till perplexity &co. catch up? Will they be allowed to do something then? I honestly don't see what's asked of google here.
Yes, they are massive. But they're massive because they've invested billions ($, manhours, etc) into their infra and have gathered a huge baggage of data, know-how, tech and expertise in this field. But what exactly are they to do from now on?