The Prodigy Preservation Project

July 14th, 2014 by Benj Edwards

Prodigy Online Service Logo

[ Major Update: 4/12/2017 – Keep an eye on my Flickr account where I will be posting galleries of Prodigy screenshots and other artwork. ]

[ Major Update: 6/6/2017 – Our Prodigy Reception System reverse-engineering tools have been released. ]

[ Major Update: 1/15/2021 – Phillip Heller has begun reverse-engineering the Prodigy client. ]

Since last year, I have been working with Jim Carpenter, a freelance programmer by trade, on hunting down old Prodigy data so that we may preserve it, display it again, and perhaps even one day use it to recreate Prodigy itself.

We’re calling it the Prodigy Preservation Project.

By now you may have seen my latest piece for The Atlantic entitled Where Online Services Go When They Die: Rebuilding Prodigy, One Page at a Time. That article describes the genesis of the project while also diving into the technical back story of the Prodigy service.

The reason we have any hope of doing something like this is because Carpenter discovered that Prodigy screen data can still be found in the STAGE.DAT and CACHE.DAT files located in used Prodigy client directories.

Those two files were used as cache files to speed up load times when using the service. When connecting to Prodigy, the client would download page data into the files. Whenever the client last connected to Prodigy, that data got frozen in time. If a vintage Prodigy client install still exists, we can get at the “frozen” data today.

Here are some screens that Carpenter pulled from a STAGE.DAT I had in my personal archives (these are from a STAGE.DAT file dated October 6, 1996):

Prodigy Login Screenshot from Benj Edwards STAGE.DAT Prodigy Rebel Space Screenshot from Benj Edwards STAGE.DAT Prodigy Encyclopedia Screenshot from Benj Edwards STAGE.DAT Prodigy Golf Tour Screenshot from Benj Edwards STAGE.DAT

Prodigy Greeting Cards Screenshot from Benj Edwards STAGE.DAT Prodigy Email Template Screenshot from Benj Edwards STAGE.DAT Prodigy Phone Directory Screenshot from Benj Edwards STAGE.DAT Prodigy Problem Error Screenshot from Benj Edwards STAGE.DAT

We can extract these screens using a series of Python programs written by Carpenter. They read through a previously used STAGE.DAT file, generate a list of pointers to the pages or object data contained within, then direct the Prodigy Reception System client to display them one at a time so we can take screenshots.

Jim’s code is not ready for release yet, but he hopes to polish it up enough to put up on GitHub soon. It has a long way to go before becoming a turnkey solution to extracting and displaying the data found in STAGE.DAT files. We’re working on it.

With that in mind, I’ve written the rest of this post in the form of a Frequently Asked Questions.

How Can I Help?

After looking around for more Prodigy installations on and off for the past year, Carpenter and I recently decided to go public with our project and ask for your help. If you have any previously used Prodigy client installations sitting around in backups or on old hard drives somewhere, we would love to hear from you.

Can I Provide Financial Assistance?

Yes. In fact, I have set up a Patreon campaign that will partially fund all of my history-related work, including the Prodigy Preservation Project. Your pledge will give me more time to devote to the PPP.

What Do You Need?

In order for a Prodigy client directory to contain any useful data, that particular installation had to be used to connect to Prodigy at some point.

This means that we do not need original Prodigy installation disks; they were never used to connect to the service, and thus do not contain any downloaded data.

So if you find a Prodigy client directory that is sitting on an old hard drive or in an old system backup, ZIP up the whole folder/directory and send it to us.

How Can I Send You My Data?

Carpenter and I are working closely together on this project at the moment, and I am acting sort of like a data secretary for him, obtaining data and organizing it in a shared repository so he can go through it when he gets the chance (he professes to be a perpetually stressed, last-minute deadline programmer that is always short on time).

I’ll also be using Jim’s software to extract what I can. But his software still needs improvement — it only works with MS-DOS Prodigy clients as of this writing, for example — so this whole project is very much a work in progress.

If you find any data from any platform, describe what you’ve got in an email to me and attach the data in a ZIP file.

Who Are You and Why Are You Doing This?

My name is Benj Edwards and I am a tech journalist that specializes in computer and video game history. For the past nine years, I have been professionally researching, interviewing, and writing about tech history with a goal to both preserve and educate. I have also run this blog since 2005.

I am working on this Prodigy project because I have always been fascinated with online services since I was a kid. I first connected to Prodigy in 1992 and was amazed. Today, if you look for info on Prodigy online, you will find very little information about it (especially in terms of screenshots), and that is a shame.

I believe the old Prodigy data is worth preserving as a cultural treasure from the early online era. It was a cultural reference point of an entire computer-using generation that grew up with it, and it is now missing from our cultural heritage. At the moment, no one can go to a library or a website and see what was on Prodigy back in the day, so in future generations, we won’t be able to point to it and say, “See? This is what it was like.”

Reasons for preserving this data are too numerous to go into here, but they will become more obvious to everyone as people continue look at the past in a search for information on the formative experiences that made them who they are today. (By the way, whole families were founded on Prodigy, with their parents having met on the service, so this inquisitiveness will continue for generations to come.)

What Are You Going to Do With What You Find?

For now, I am planning a gallery of every Prodigy screenshot I have ever found. It may end up on Flickr or this site, so stay tuned.

As for screens extracted from STAGE.DAT files, so far the only STAGE.DAT that had usable data was the one I found last year in my archives. But in the past few days, I’ve received three more promising Prodigy directories that we will be looking through soon. We will add whatever we find to our Prodigy screenshot gallery.

In the long term, I would ideally like to create a simulation of Prodigy with a Reception System written in Javascript (so it can run in any browser). It will deliver original Prodigy data to users and allow them to experience what the service was actually like back in the day. That is a potentially huge project that is a long way off, however.

Less ambitiously (but still ambitious), Jim would also like to create a Prodigy server simulation that can deliver original Prodigy objects to the original Reception System client.

In the mean time, Jim and I will be going through the data and sharing what we find.

I Don’t Have a Prodigy Client, But I Have Other Prodigy Information. How Can I Help?

Carpenter and I are working on reverse engineering the entire Prodigy service, backend and frontend. If you have any internal Prodigy documents that describe, in detail, how any part of Prodigy worked, we would love to see it, as it will be very helpful in our mission.

I’m also working on a general history of the service, so literally anything and everything can be useful. Personal stories of using the service, documents, photos, software, data, code, internal Prodigy software tools, screenshots, artwork. You name it. All of it will be useful in building a more accurate historical record of this most unique online service. Send me an email.

What Happened to The Original Prodigy Data That Was On Its Servers?

Good question! I’m currently talking to ex-Prodigy employees about whether that data even exists at all at this point in time. I’ve discovered some interesting tidbits, but it’s too soon to say anything definitive. If you know anything about it, please send me an email.

How Can I Search For Old Prodigy Installations?

If you want to do a targeted search for old Prodigy data, I have a few tips.

  1. Look in your own archives. This is what I did when Jim told me about his Prodigy technique last year. While I didn’t find my original Prodigy client installation from 1992, I did find a backed-up Prodigy client directory from 1996. Obviously, you have to be a bit of a data pack rat for this method to be useful.
  2. Ask around. Find old Prodigy users, and ask them to look through old system backups, which may be on floppy disk or CD. Or they may simply have their old PCs with intact hard drives still inside. You may have to help them liberate the Prodigy data from various obsolete storage formats.
  3. Target IBM PS/1 machines. The Prodigy client shipped with most consumer IBM PCs after the service’s launch in 1988. That means if you find, say, an in-tact IBM PS/1 of any model from the early 1990s, or some PS/2s, it is very likely to have a Prodigy directory sitting on its hard drive. If the user of that machine tried Prodigy even once, it should have some useful data in its STAGE.DAT and CACHE.DAT files.

    Also, you can target the hard drives that commonly shipped in IBM PS/1 machines. I determined common models a few months ago, but I need to find my notes and put that info up here later.

  4. Search Hard Drives in Bulk. Another approach is to comb through bulk collections of old hard drives. PC hard drives under 500 MB (all IDE Parallel ATA drives) are most likely to have a form of Prodigy Classic client on them. I myself have done this, buying up dozens of scrap and surplus hard drives and searching for STAGE.DAT files in them. It is a needle-in-a-haystack approach, but it is faster to search through bulk collections of hard drives than to buy 100 old PCs, move/ship them, and go through them one at a time.

    Obviously, user privacy is of the utmost importance when handling used drives with personal data on them. Luckily, if you scrape out a C:\Prodigy directory, it’s almost guaranteed to have no personally sensitive information on it. It is your responsibility to then securely discard data on the rest of the drive. Of course, if you do that, you may also lose some other data of historical value on the drive that we don’t even know is important yet. You’ll have to cross that ethical bridge when you come to it.

    By the way, using this method, I have found no working Prodigy directories (it is, admittedly, a long shot), so I stopped after going through about 100 hard drives. The biggest problem for me is that 90% of the hard drives I could obtain were too recent. I asked around, and most MS-DOS era drives have been sold as scrap and shredded years ago. But it’s still a possible approach if you have access to a stack of old drives.

The Project Continues

Thanks for everyone’s help so far, including the dozens of ex-Prodigy personnel I have spoken to about their amazing work with the service. I wrote this information out as quickly as possible, so I will likely keep revising it over the next few days. Keep an eye on this blog (and this post) for future updates.

[ Edit: 04/12/2017 – I changed the name of the project from the “Prodigy Restoration Project” to the “Prodigy Preservation Project” to reflect the growing role of our simply collecting Prodigy screenshots and documents for preservation. Re-creating the Reception System in Javascript is still a goal, however.]


Benj’s Other Writings about Prodigy:

Classic Prodigy Game Recreation MadMaze-II Updated to Support Chrome and Firefox (VC&G, 2017)
Exploring the Lost World of Prodigy (PCWorld, 2016)
Where Online Services Go When They Die (The Atlantic, 2014)
The New Prodigy (Retro Scan) (VC&G, 2014)
MadMaze-II Now Hosted on Vintagecomputing.com (VC&G, 2013)
Prodigy 20 Years Ago Today (VC&G, 2012)
Prodigy Lives! Play MadMaze On the Web (VC&G, 2006)



24 Responses to “The Prodigy Preservation Project”

  1. D.D. Says:

    I’ll have to see if I can get the hard drive from my family’s old IBM PS/1 working, since I did give the Prodigy free trial a spin a while after we got it in ’94. I’ll see if I can get a post about the project approved over at Soylent News in hope readers also have old archives sitting around.

    If the screenshot archive grows large enough, hopefully it will give me a better idea of how the service worked for when I’m working on the early history of a longtime fan club (udic.org). Being able to restore the message boards would be even better, but at least with screenshots I might be able to make more sense of the few existing descriptions I’ve been able to find. 🙂

  2. Jim Says:

    Sounds interesting Benj! I’m 99.99% sure I don’t have any old Prodigy data since I really didn’t use the internet until the mid 90’s with Netscape and a local ISP, but you never know.

  3. Justin Salvato Says:

    Thank you for this. I would love to see Prodigy up in some way. I have 3 IBM PS/1 computers that I purchased in the last few years. I’ll see what I can gather in terms of software. The PS/1 I owned back in 1990 is probably in a trash heap somewhere (gasp). That would have had quite a DAT file as I was on Prodigy everyday.

  4. Multimedia Mike Says:

    I love the ambition of this effort. Best of luck to you. Prodigy was my very first online experience back in 1991. I’m sure the 20 MB hard drive that housed the STAGE.DAT file (filename sounds vaguely familiar) is long gone, though, and the data would not have been migrated forward to other drives, matryoshka-directory style.

  5. Ant Says:

    I don’t have the HDDs since the old PCs were donated. 🙁

  6. Luis Mercado Says:

    I am a veteran at Neowin’s forum. I bet there are a couple of old timers there that could provide something.

    With your permission I would like to make an official thread there, copying this FAQ verbatim and asking for help.

  7. Benj Edwards Says:

    That is fine with me, Luis. Feel free to post the FAQ there, and let me know if you get any leads from it. Thanks!

  8. Dave Says:

    I know this is an old post but I was just checking in to see if there was any update as to how this is going. I have tons of memories about the Prodigy service and I’m really excited about this one. Thanks Benj.

  9. Justin Says:

    Any updates? Long live Prodigy!

  10. Gallara Says:

    Looks like I am not the first Ultima Dragon to be interested in this project! Most of the first three years of our history, the club that became the UDIC in 1994, are locked up in Prodigy archives. I’m also interested in any of the Bulletin Board posts or the UG mails if they still exist. Keep an eye out for terms like Drunken Stupor, GC, G@C, Wingers, Inner Circle, Upper Circle, etc., or anything with “_____ Dragon”. I have some accounts from older Dragons but most of them are shrouded in fuzzy memory. Here’s hoping some can be recovered before the entire service becomes NMPRed.

  11. Mike O'Connor Says:

    The screens use NAPLPS encoding, right? At least they did at one time. I was writing for mainframes at the time and applied for a job at Trintex (later renamed Prodigy) back when I lived in White Plains, but didn’t get it – IBM was pretty stodgy back then to say the least, and I… wasn’t. I had written a NAPLPS interpreter then. It was a sort of extension to ASCII that let you add graphics and such to computers of the day, while being able to transmit the whole thing as though it was text. That was decades ago, I’m sure I couldn’t come up with the code or even the docs for NAPLPS any more, but it wasn’t a terribly hard thing to write, I remember. I think Popular Electronics had an article or series on it, which was what got me interested back then. I ended up writing stuff that worked on CompuServe instead, most notably CompuServe MacNav software. Anyway, maybe you could find a NAPLPS interpreter somewhere!

  12. Jim Says:

    I have stage.dat and cache.dat files dated 11/7/1990 which was around the time I used Prodigy, and would love to see what is in them. I am a little concerned about my privacy if I send them to you since I have no idea what might be in them. Do you have any kind of privacy policy? I wouldn’t want a personal Prodigy email to be shared publicly, for example.

  13. Benj Edwards Says:

    Jim,

    Your files would be wonderful to add to our project. I’m not sure exactly where personal emails would have been cached (I’d have to ask Jim Carpenter, my technical guy, about that).

    But regardless, we will never release anyone’s personal information unless they give us express permission to do so. Whatever we recover we will send back to you first to check out. I’ll send you an email.

  14. Brian Ahier Says:

    Can you emulate a prodigy on another system?

  15. Meteo Says:

    Anyone email me; – tell me anything about a Prodigy restoration, or stuff from there; – I was ABRA25C on there.

  16. Al Sirois Says:

    Prodigy came from Trintex, the bastard brainchild of CBS, IBM and Sears… and both Trintex andProdigy got mentions on the Netflix series HALT AND CATCH FIRE, which was kind of cool for those of us who were there.

  17. DB Says:

    Anyone that still has an IBM PS/1 around should check and see if there are any Prodigy files on them as it was preloaded on every model. Unfortunately, on my models, it was never used.

  18. Nancy C Says:

    Watching CNN’s “The Nineties – Information Age” episode tonight, sent me on a search for a place to download classic Prodigy wav files. That search led me to your site. I am so glad to read about your project! I was an early Prodigy subscriber and was faithful until the end.

    Prodigy needs to be recognized as a pioneer in online services. Remember – it was a joint venture between CBS, IBM and Sears. AOL was not first! (I never did become an AOL user.)

    In my hardware graveyard, I do have my IBM PS/2 that I used to connect to Prodigy. It may take a while, but I will check the DAT files. 🙂

  19. Russell Crow Says:

    I remember using Prodigy in the early 90’s out of curiosity. I had made contact with people in eastern European countries that had gained their freedom after the Soviet era. Those people seemed to so enjoy making contact with people outside their countries. I had wondered from time to time what had become of Prodigy. For me my use of it was almost like an early Facebook. AOL in those days kept mailing discs to your address to try to snag you into joining them. I did join AOL and that was the end of my Prodigy days. Thinking back on it in some ways the Prodigy experience was richer and more fun than AOL. However I had slipped away. I do have a file of some Prodigy conversations and stuff I printed out with a dot matrix printer, and put in a hanging folder. Lately I’ve been organizing and going through old stuff in my basement. Tomorrow I will probably fathom the depths of that long ago saved Prodigy folder, and peer into pieces of history of my early days on the personal computer and internet.

  20. KFMY54A Says:

    What’s the latest on this project?

  21. Eric Says:

    I played fantasy baseball and traded stocks with DLJ Direct using Prodigy in 1992 at 2400 baud on my PS2. Good memories.

  22. Lara Says:

    Is there an update on this project?

  23. Sue Audrain Says:

    I was Prodigy every day for years in the late 80s early 90s. A group of ten if us wrote an online novel called The Paradise Hotel on one of the Prodigy Bulletin Boards/Message Boards. I believe it was under creative writing.i had printed out all of the posts but lost ot all because of Hurricane Andrew
    It would be so wonderful to be able to log back in and get access to all that work. Please let me know if you gane access to the old data or reup Prodigy. Thanks! Sue A user number SPTM08A (or was it SBTM08A)

  24. Jay Says:

    Just shooting this out into the atmosphere, since it seems like this project hasnt had any updates in a very long time, but was there ever any progress made? This is a nostalgic age, and Prodigy was my first online experience.

Leave a Reply