I know ChatGPT is not perfect. Everyone, including ChatGPT, will tell you this. It was a simple test to determine if it would be helpful – parse a list of domain names.
I have a list of a little over 1300 domain names. While working on this site (Discovr.ai), I wanted to separate my medical and health related domains from the list. I felt it was time to start building my individual categories. The prompts I gave were clear: based on the keywords in the list, identify the medical and health related names.
The first list comprised a whopping 34 names. I immediately knew this was big GPT fail because I have a pretty good idea what is on my list. I have a medical background and I tend to look for this niche.
Looking at my list, I started feeding some of the misses into GPT. The most glaring omission was the first name on the list – AllergicReactions.net. To me, this should have been a no brainer – there is really no other classification for such a name. When I presented this to GPT, the response was:
Yes, allergicreactions.net is indeed a domain name related to the medical field. It directly pertains to allergic reactions, a common medical issue that involves the body’s immune response to substances. This domain would be relevant for providing information on symptoms, treatments, and prevention of allergic reactions. It should have been included in the list of medical-related domain names.
I asked GPT to revisit the list.
This process went on for quite some time. The second list did include AllergicReactions.net to bump the list up to 35 names but still missed so many obvious domains – ePrescribe.com, mHealth.net, SkinInvestigation.com, tMedicine.org – it got to the point now I was manually checking the 1300+ list to what ChatGPT was interpreting medical or health related names.
Time after time, I was asking GPT to check again, add this, add that, you missed this and each time ChatGPT was apologetic:
Thank you for providing the additional domains. I’ll ensure these are included in the comprehensive list of healthcare and medical-related domains. Here is the updated and alphabetized list:
I apologize for the oversight. syntheticdrug.com should indeed be included as it relates to the development and study of synthetic drugs, which is relevant to the medical field.
You’re right; asthmatic.net is clearly health-related, focusing on asthma—a common respiratory condition. I apologize for the oversight. I’ll take another thorough look and add all health or medical-related domains, including those previously missed like asthmatic.net, to ensure the list is comprehensive and accurate. Here is the updated and alphabetized list:
Slowly but surely, we were able to bump up the list to 56, 72, 83, 90…by now I had already asked GPT to alphabetize the list so I could check them off as we went along.
By the time we finished, (actually mostly me) we were able to identify 170 domains that were healthcare or medical related. I did not time the process since I was confident ChatGPT was not going to let me down.
But to miss 135 names? Words like Dyspnea.net, Asthmatic.net, Aphagia.com. Others like gyne.net, Hyperglycemic, SmartDrugs.Ai, VaccinesAi.com. Words that have no other meaning or classification other than medical or health related. Dyspnea and Aphagia mean one thing. Impossible to get these confused.
I know I had spent over an hour on the list in total to clean it up, uppercase the parts appropriately, and so on. I wanted so badly to have this work as I was sure I would be able to go through the entire list, give it different categories to parse like Travel, Technology, Lifestyle, etc.
Bottom line, I could have manually performed this task in less time than I had spent with this little project.
Are the other Ai creations like Claude and CoPilot any better? We’ll see.
UPDATE 06/13
Something very strange and disturbing happened. After running my list through Anthropic/Claude and finding one “made up” domain I decided to look closer at my final list from ChatGPT. I found 13 domains added to my list that I do not own. And I would LOVE to own all of these prime keywords starting with Ai followed by Biotechnology, CancerResearch, Dermatology, Epidemiology, Genomics, Healthcare, HealthData, HealthSystems, MedicalDiagnostics. MedicalImaging, MedicalResearch, MentalHealtrh, Nursing, PatientCare, Surgery, Therapeutics .com. That to me is prime real estate mainly because I belief Healthcare will be the single most beneficiary to using Ai.
I am lost trying to figure our WHY ChatGPt added these.
This makes ChatGPT a huge fail in this early testing. So my final list of 170 is pared down to 157.
Spotted In The Wild features live websites presently using .Ai domain name extension
