OpenAI is crawling the MFGG forums

OpenAI is crawling the MFGG forums

United States

VinnyVideo

Can't have an avatar without a Shy-Guy
Site Developer

Site Developer

Main Site Moderator

Site Developer/Webmasters

Wiki SysOp

Big Help

Submitter

Super Reviewer (2)

Wiki Contributor

Sprite Comp Runner-Up

Minigame Comp Winner

Minigame Comp Runner-Up

Minigame Comp Top 5 (3)

Music Comp Winner

Music Comp Runner-Up

Music Comp Top 5 (2)

Drawing Comp Top 5

Game of the Month Winner

NCFC Contributor (4)

Secret Santa (5)

MFGG 17th Anniversary

MFGG 18th Anniversary

MFGG 19th Anniversary

Ye Olde MFGGe Retro Game Jam Participant

MFGG Awards 2010 Winner

MFGG Awards 2011 Winner

MFGG Awards 2012 Winner

MFGG Awards 2013 Winner

MFGG Awards 2014 Winner

MFGG Awards 2015 Winner

MFGG Awards 2017 Winner (3)

MFGG Awards 2019 Winner

MFGG Awards 2024 Winner

#3

02-24-2025, 11:12 PM

Yeah, these LLM bots can be pretty thirsty for bandwidth. I don't think OpenAI's crawler is adding much value for us, so let's see if a robots.txt update will be enough to get it to pack its bags.

Course clear! You got a card.

[Image: CourseClear.gif]

[Image: CourseClear.gif]

« Next Oldest | Next Newest »

Users browsing this thread: 2 Guest(s)

Messages In This Thread

OpenAI is crawling the MFGG forums - by Q-Nova - 02-23-2025, 04:47 PM

RE: OpenAI is crawling the MFGG forums - by AGuyCalledKlaz - 02-23-2025, 08:29 PM

RE: OpenAI is crawling the MFGG forums - by VinnyVideo - 02-24-2025, 11:12 PM

RE: OpenAI is crawling the MFGG forums - by Q-Nova - 03-05-2025, 01:38 AM

RE: OpenAI is crawling the MFGG forums - by DJ Coco - 03-05-2025, 05:55 AM

RE: OpenAI is crawling the MFGG forums - by VinnyVideo - 03-08-2025, 09:57 AM

RE: OpenAI is crawling the MFGG forums - by Vert - 03-10-2025, 03:26 PM

RE: OpenAI is crawling the MFGG forums - by VinnyVideo - 03-10-2025, 09:16 PM

RE: OpenAI is crawling the MFGG forums - by Q-Nova - 04-17-2025, 01:55 PM

View a Printable Version