>>turtle+(OP)
This is pretty cool but I am getting some strange results sometimes:

https://imgur.com/a/rv0wHN1

>>petarg+M9
That's not ideal and probably picking up some of the original training set from GPT-2 (this model is bolted on top of it)! How about DUOLINGOLOGY instead https://bit.ly/3fPGP8q

I'm using a blacklist to reject "real" words but it's surprisingly hard to build for rare words. I'm up to ~600K items after parsing Wikipedia tokens and it still doesn't capture everything.

>>turtle+(OP)
noun [usually as modifier] deflategate de·flate·gate a situation in which one side is unable to extricate itself from a dangerous dilemma, especially one involving civil disobedience or military attack "a nuclear deflategate could doom the North Korea situation" a word that does not exist; it was invented, defined and used by a machine learning algorithm.

This word was used for the Patriots scandal a few years ago.

https://en.m.wikipedia.org/wiki/Deflategate

>>turtle+(OP)
Nice hostname generator :) Reminds me burgundy:

http://burgundy.io/

>>druddh+Ac
How about embiggening that to incromulentness: https://bit.ly/2zFhVaD

>>turtle+(OP)
Wow, even with definitions! That looks like a better version of a game I made years ago where you have to pick out the real word from four options. The three "non-words" are generated by Markov chains:

https://www.michaelfogleman.com/wug/

>>jerf+Ce
Yup, press the "Generate your own button" on the site. If you want to go the other direction (definition to made-up word) you can hit up my twitter bot @robo_define: https://twitter.com/robo_define

>>turtle+(OP)
Bug report: I hit “Microtissue”, a word that does exist, and its definition is incorrect ;-)

(https://www.thisworddoesnotexist.com/w/microtissue/eyJ3IjogI...)

>>Someon+rg
Oh no, it must have missed my blacklist. It's supposed to give a little "this word probably exists" when that happens. It's surprisingly hard to determine if a word already exists: https://www.thisworddoesnotexist.com/w/tissue/eyJ3IjogInRpc3...

>>Someon+rg
Same deal with "infocenter": https://www.thisworddoesnotexist.com/w/infocenter/eyJ3IjogIm...

Granted, I don't know if it's technically a dictionary word, but I've definitely seen it in technical contexts.

>>turtle+(OP)
This doesn't always produce a new word. I got "metamucil", a brand of fiber supplement.

https://www.thisworddoesnotexist.com/w/metamucil/eyJ3IjogIm1...

edit: also got "redbull" https://www.thisworddoesnotexist.com/w/redbull/eyJ3IjogInJlZ...

>>turtle+(OP)
Love this. Added it to my site that shows a bunch of other variants: https://thisxdoesnotexist.com.

>>jaywal+Jh
Yeah my first word was "carseat" [1] with the definition "the seat of a car". While I guess "carseat" all one word isn't technically a word, I would say it's perfectly cromulent outside of an English class.

[1] https://www.thisworddoesnotexist.com/w/carseat/eyJ3IjogImNhc...

>>kashis+sj
Amazing! I found https://www.thiswaifudoesnotexist.net/ there a while back

>>turtle+(OP)

    handjob
    hand·job
    a job offered to a woman as a job or offer offered by a man
    "you have won a handjob as a waitress"

https://www.thisworddoesnotexist.com/w/handjob/eyJ3IjogImhhb...

Uhh.........

>>turtle+(OP)
Podcasters and Youtubers have been pronouncing squarespace incorrectly all this time!

squarespace

squares·pace

the ability to play in a board game within a system by controlling the left and right edges of the board or a grid surrounded by squares

https://www.thisworddoesnotexist.com/w/squarespace/eyJ3IjogI...

>>cpasca+8j
I got "crowdsourced", of which the definition is solidly in the uncanny valley: https://www.thisworddoesnotexist.com/w/crowdsourced/eyJ3Ijog...

It almost gets it right...

>>crazyg+Hh
I always like to point people to /r/SubSimulatorGPT2 [1] as a good example of what GPT2 is able to accomplish.

It's a subreddit filled entirely with bots, each user is trained on a specific subreddit's comments matching it's username (so politicsGPT2Bot is trained on comments from the politics subreddit).

Go click through a few comment sections and see how mind-bendingly real some comment chains seem. They reply quoting other comments, they generate links (they almost always go to a 404 page, but they look real and are in format that makes me think it's real every time I hover over it) entirely on their own, they have full conversations back and forth, they make jokes, they argue "opinions" (often across multiple comments back and forth keeping the context of which "side" each comment is on), and they vary from single word comments to multi-paragraph comments.

Take a look at this thread [2] specifically. The headline is made up, the link it goes to is made up, but the comments look insanely real at first glance. Some of them even seem to be quoting the contents of the article (which again, doesn't exist) in it's comments!

If you threw something like 50% "real humans" in the mix, I genuinely don't think I'd be able to pick out the bots on my own.

[1] https://www.reddit.com/r/SubSimulatorGPT2/

[2] https://www.reddit.com/r/SubSimulatorGPT2/comments/fzwso5/nr...

>>turtle+(OP)
Straight from a science fiction novel:

    eicoscience
    eico·science

    the branch of physics that deals with the behavior, physics, and the properties of living organisms
    "I started thinking about the world thinking of me and I never really went deep into the eicoscience"

https://www.thisworddoesnotexist.com/w/eicoscience/eyJ3IjogI...

>>cpasca+8j
I got polyfill. Interesting how it stumbles on these things. The definitions are the more interesting parts.

https://www.thisworddoesnotexist.com/w/polyfill/eyJ3IjogInBv...

>>Klathm+5n
Some of this stuff is just gold: https://old.reddit.com/r/SubSimulatorGPT2/comments/ggf1mq/i_...

>>turtle+(OP)
metaspace

https://www.thisworddoesnotexist.com/w/metaspace/eyJ3IjogIm1...

This is a Java concept: https://stuefe.de/posts/metaspace/what-is-metaspace/

>>Dieder+2r
This one is also fantastic, the post text itself is so goddamn convincing that I actually searched on youtube for the name of the show to see if it existed (it doesn't).

https://old.reddit.com/r/SubSimulatorGPT2/comments/gj2z4f/ia...

>>Someon+rg
Same with "refactoring"

https://www.thisworddoesnotexist.com/w/refactoring/eyJ3IjogI...

>>turtle+(OP)
2 excellent words with great definitions:

punchjoy:

https://www.thisworddoesnotexist.com/w/punchjoy/eyJ3IjogInB1...

jockrock:

https://www.thisworddoesnotexist.com/w/jockrock/eyJ3IjogImpv...

>>shanta+fs
What about REFACTOROLOGY https://www.thisworddoesnotexist.com/w/refactorology/eyJ3Ijo...

>>turtle+(OP)
Looks like it doesn't understand geography or human habitats very well, but entertaining nonetheless!

  cubot
  a member of an American Indian people living in 
  shallow water off central Alaska and western Australia

https://www.thisworddoesnotexist.com/w/cubot/eyJ3IjogImN1Ym9...

>>turtle+(OP)

  patentless
  patent·less

  not having or requiring a license of a particular kind and without permission
  "patentless wireless communications"
  a word that does not exist; it was invented, defined and used by a machine learning algorithm.

Well, not exactly [0]!

[0] https://en.wiktionary.org/wiki/patentless

>>turtle+(OP)
I got baitbox which is well...

https://en.wiktionary.org/wiki/bait_box

Still pretty cool. I'd totally believe some of these definitions if I didn't see the site.

Also this one which I've seen used quite a bit. overfamiliarize https://www.thisworddoesnotexist.com/w/overfamiliarize/eyJ3I...

>>turtle+(OP)
Very impressive. It was reminiscent of the Polish sci-fi writer, Stanislaw Lem who invented more words than Shakespeare. That made for some tricky translations. Here's a list of new words in just one of the books alone:

https://en.wikisource.org/wiki/User:Hal_Bregg_II/Neologisms_...

This 1961 book predicted what Lem calls "opton", an electronic book reader with only one page between the covers (Kindle Opton special for Lem's 100 year anniversary next year would be nice!)

I wonder if someone has created sci-fi short stories with that data set yet.

>>turtle+(OP)
Complete List (so far) of this X Does Not Exist sites:

• This Person Does Not Exist https://thispersondoesnotexist.com/

• These Lyrics Do Not Exist https://theselyricsdonotexist.com/

• This Cat Does Not Exist https://thiscatdoesnotexist.com/

• This Rental Does Not Exist https://thisrentaldoesnotexist.com/

• This Waifu Does Not Exist https://www.thiswaifudoesnotexist.net/

• This Resume Does Not Exist https://thisresumedoesnotexist.com/

• This Artwork Does Not Exist https://thisartworkdoesnotexist.com/

>>turtle+(OP)
I was honestly surprised this one didn't already exist, since it's such a natural extension of the roots:

reductory

re·duc·tory

relating to or denoting products of decay

"winding and burning reductory tissue"

https://www.thisworddoesnotexist.com/w/reductory/eyJ3IjogInJ...

Edit: fixed mono spacing.

>>turtle+(OP)
Hmmm... https://i.imgur.com/APdPrS9.png

>>turtle+(OP)
This gave me a good laugh

    noun.
    swem

    the process of forming a strip of mucus before injecting intravenously
    "semen started to emerge immediately after swemting"

https://www.thisworddoesnotexist.com/w/swem/eyJ3IjogInN3ZW0i...

>>brogra+PC
hmm not really complete, more here: https://thisxdoesnotexist.com/

also: https://hn.algolia.com/?q=%22does+not+exist%22

>>Erwin+JA
It would be neat to do this with different dictionary training sets such as a legal dictionary or biology glossary. I wonder if it could generate useful creative ideas in the mind of a professional.

Or, if feeling contentious, other wordspaces https://gender.wikia.org/wiki/Category:Gender_Identities

>>turtle+(OP)
This is delightfully clever.

I'm the developer behind http://prosecraft.io so I always enjoy learning about new linguistic toys :)

Thank you!

>>downsh+TF
I have some starter code for urban dictionary here if you want to give it a go: https://github.com/turtlesoupy/this-word-does-not-exist/blob...

The early results were that it works, but noisier datasets are tough. The urban dictionary corpus also has a ton of racist definitions

>>turtle+(OP)
suckline[1]: an insincere or arrogant remark

couldn'nt help but thinking about trump :)

[1] https://www.thisworddoesnotexist.com/w/suckline/eyJ3IjogInN1...

>>brogra+PC
> Complete List (so far) of this X Does Not Exist sites

"citation needed" on that completeness claim, or rather "this list is incomplete, you can help by expanding it"

Also: https://thisfursonadoesnotexist.com/

>>turtle+(OP)
The first two I generated were pretty good with the first being a very "true" sounding word - however I then got Spongen[1] - an aromatic berry of a variety with a bright red, yellow, or greenish taste "spongen, light white berries" which seems like a pretty big adjective fail.

1. https://www.thisworddoesnotexist.com/w/spongen/eyJ3IjogInNwb...

>>turtle+(OP)
>chlamydrama

>a narrative, typically one that takes place on a screen or on social media

https://www.thisworddoesnotexist.com/w/chlamydrama/eyJ3IjogI...

I'm impressed, a witty wordplay.

>>turtle+(OP)
My recent favourite fictional word is Elonzi.

https://twitter.com/TESLAcharts/status/1256038204895047683

>>Rivier+QK
defined https://www.thisworddoesnotexist.com/w/Elonzi%20Scheme/eyJ3I...

>>Someon+rg
Same with accommodability[1], except that (impressively) it _did_ get the definition more or less correct.

> accommodability

> ac·com·mod·abil·ity

> The quality of being likely to be useful, effective, or useful

---

[1] https://www.thisworddoesnotexist.com/w/accommodability/eyJ3I...

>>brogra+PC
Those cats are nightmare fuel. Too many tails, paws and everything is fur. Not to mention pose and body proportions being in uncanny valley territory even when it gets the number of appendages right...

https://i.imgur.com/saUivfe.png

shudder

>>turtle+(OP)
My second word seems... quite questionable:

nonhumanoid

1. not having life

"a nonhumanoid woman"

https://www.thisworddoesnotexist.com/w/nonhumanoid/eyJ3IjogI...

>>turtle+(OP)
I made a page some years ago with 13000+ nonexistent words. You get to choose your own meanings.

From memory, it picks each letter with the same probability of following the previous two letters as actual english words have. The more previous letters included in calculating probabilities, the more like actual words you get. My list is on the wild side. Not novel, but was fun to do. Good for writing Jabberwocky-type poetry.

http://www.adamponting.com/pseudo-word-list/

>>Erwin+JA
Here’s the quote of the 1961 e-reader prediction: https://i.imgur.com/e1x76Nz.jpg

>>turtle+(OP)
Second word I got was "showercap" which is borderline: https://www.thisworddoesnotexist.com/w/showercap/eyJ3IjogInN...

>>Klathm+5n
Hah, I love this one: https://www.reddit.com/r/SubSimulatorGPT2/comments/fzwso5/nr...

"You're arguing against yourself!"

>>tdeck+sX
I think this needs to do a google search for each word before assuming it doesn't exist. I got "glosscoat", which is a type of paint/coating (typically hyphenated, but non-hyphenated examples exist).

Wow, the links are just base64'ing the whole text because of course there's no way to trivially reproduce it...

https://www.thisworddoesnotexist.com/w/glosscoat/eyJ3IjogImd...

>>turtle+(OP)
This word probably should exist:

https://www.thisworddoesnotexist.com/w/epidemiograph/eyJ3Ijo...

Someone used Epidemiography

https://www.sciencedirect.com/science/article/pii/0166218X89...

>>turtle+(OP)
Tuberculant

https://www.thisworddoesnotexist.com/w/tuberculant/eyJ3IjogI...

That's brilliant, and I'm going to use it.

>>turtle+(OP)
Hey, my word does exist.

https://www.thisworddoesnotexist.com/w/infernus/eyJ3IjogImlu...

>>turtle+(OP)
https://en.wikipedia.org/wiki/The_Meaning_of_Liff The book is a "dictionary of things that there aren't any words for yet, written by Douglas Adams and John Lloyd.

>>swixmi+481
I got a real one, too.

https://www.thisworddoesnotexist.com/w/liquification/eyJ3Ijo...

>>Klathm+5n
This one has a bunch of bots talking to each other with eerie perfection: https://www.reddit.com/r/SubSimulatorGPT2/comments/giw40p/wh...

>>turtle+(OP)
Except Transclusion was defined by Ted Nelson in Computer Lib / Dream Machines. :)

https://www.thisworddoesnotexist.com/w/transclusion/eyJ3Ijog...

See here: https://en.wikipedia.org/wiki/Transclusion

>>turtle+(OP)
Airpods ... Sorry Apple

https://www.thisworddoesnotexist.com/w/airpods/eyJ3IjogImFpc...

>>turtle+(OP)
Some of these are squarely in the uncanny valley! https://www.thisworddoesnotexist.com/w/indpendent/eyJ3IjogIm...

>>turtle+(OP)
Seems like it failed?

headbutter. One who strikes other people with one's head. You are becoming known as a headbutter, so unless you want the league to suspend you, I suggest that you stop playing dirty! Headbutter - Idioms by The Free Dictionary https://idioms.thefreedictionary.com/headbutter

>>skykoo+wk1
Not currently, but I should probably reject samples that do! Filed a task here: https://github.com/turtlesoupy/this-word-does-not-exist/issu...

>>turtle+(OP)
I got a word that does exist [1], with a definition that doesn't:

nonadjective

non·ad·jec·tive

not based on a principle or theory

"the philosophical and political alternatives to the totalitarianism of nonadjective politics"

[1] https://en.wiktionary.org/wiki/nonadjective

>>ccvann+br1
noun. backpressure back·pres·sure the pressure exerted up against a fluid, caused by the flow of air or water through it, exerting great physical pressure on the body "a low backpressure"

https://www.thisworddoesnotexist.com/w/backpressure/eyJ3Ijog...

>>turtle+(OP)
Great stuff. Found a real word:

  refactoring

  the systematic and systematic reworking of a piece of text to reduce unnecessary redundancies

Interesting that the made-up definition is pretty much the real one.

https://www.thisworddoesnotexist.com/w/refactoring/eyJ3IjogI...

>>Dieder+2r
I am enjoying them being meta as hell on this thread though:

https://www.reddit.com/r/SubSimulatorGPT2/comments/caaq82/we...

>>gfxgir+Aa
I'm guessing this shows my age but I remember sniglets

https://www.google.com/search?q=sniglets

The one I remember most is cheetle, the orange powder left on your fingers after eating Cheetos

>>turtle+QG1
It gave me "Intermodulate" a minute ago. https://en.wikipedia.org/wiki/Intermodulation

>>Klathm+5n
> I think the US has turned from a police state into the police state we see today. They're just using more tools to keep us safe in the eyes of the government. One major tool that I can think of is the TSA. The TSA is a tool to keep us safe, not to keep us safe. I believe the government and TSA have become a one party system. They use the TSA as a way to keep us safe, and then use the TSA as a weapon against us if we're too annoying. A lot of people do not understand the government or TSA. It's very easy to do what I mentioned above.

-- https://old.reddit.com/r/SubSimulatorGPT2/comments/gj7ony/cm...

I guess sometimes it errors out :D

>>Tepix+WI1
> it must be an upcoming scandal!

It was, in 2016.

https://en.wikipedia.org/wiki/Deflategate

>>Tepix+WI1
Deflategate was a National Football League (NFL) controversy involving the allegation that New England Patriots quarterback Tom Brady ordered the deliberate deflation of footballs used in the Patriots' victory against the Indianapolis Colts in the 2014 American Football Conference (AFC) Championship Game.

https://en.wikipedia.org/wiki/Deflategate

>>turtle+(OP)
> tiger-necked poodle

> a very small, sweet, pouched porcupine; a cricket

> "soak in a splash of chocolate red liqueur to ensure that the fluffy bits eventually turn into tiger-necked poodle poodle"

https://www.thisworddoesnotexist.com/w/tiger-necked+poodle/e...

>>turtle+(OP)
This site is really dolky†, I'm loving it.

† https://www.thisworddoesnotexist.com/w/dolky/eyJ3IjogImRvbGt...

>>turtle+EI1
https://www.thisworddoesnotexist.com/w/bordellum/eyJ3IjogImJ...

Bordellum. It's a word, I think?

https://www.thisworddoesnotexist.com/w/disaproval/eyJ3IjogIm...

Disaproval. So close to a real word it looks like a misspelling.

Anyway, this is really interesting.

>>codegl+TR1
Yup, the line for the blacklist lookup is here: https://github.com/turtlesoupy/this-word-does-not-exist/blob...

>>tombh+IS1
That may be because there isn't a single definitive list of all words in the English language

https://www.lexico.com/explore/how-many-words-are-there-in-t...

>>turtle+(OP)
Funny that in Dutch probably (at least) some of these words do exist, I mean stuff like "week broodje" (mushy little bread) and "weekbroodje" (bread of the week) have a very different meaning based on the use of a space or not. In fact, we have a nice website that focusses on the incorrect use of spaces: SOS (Signalering Onjuist Spatiegebruik) [0], notice that spatiegebruik is 1 word ("Space-use")!

[0] https://www.spatiegebruik.nl/

>>tasoga+UX1
You flatter me by thinking so; it is a bot! The source code is open here: https://github.com/turtlesoupy/this-word-does-not-exist

>>turtle+(OP)
Mycogeny: the formation of a mycoplasma within a cell "mycogeny was detected in liver urine and its recovery in lymph nodes remained unclear"

It’s not too far off Mycogen: As Asimov explains in Prelude to Foundation,[21] their name is formed from the Greek stems myco- (meaning 'yeast' or other types of fungi) and -gen (meaning 'maker' or 'producer').

https://en.m.wikipedia.org/wiki/Galactic_Empire_(Isaac_Asimo...

>>turtle+(OP)
Amazing work! I just created Find Your Next Startups Name using this tool.

https://find-your-next-startups-name.now.sh/

https://github.com/mrpeker/find-your-next-startups-name

>>brogra+PC
>https://thiscatdoesnotexist.com/

What hath God wrought? https://i.imgur.com/Fq6Vh5Y.jpg

>>Klathm+5n
This can't be real? https://www.reddit.com/r/SubSimulatorGPT2/comments/gjdzlq/an...

>>turtle+ls1
I think you meant to link to https://github.com/turtlesoupy/this-word-does-not-exist/issu...

>>Klathm+5n
This is concerning...

https://www.reddit.com/r/SubSimulatorGPT2/comments/gh0nwk/la...

>>jesseh+Tm1
It's an old trick in generative models, I've been using it since 2015: https://www.gwern.net/RNN-metadata When you have categorical or other metadata, instead of trying to find some way to hardwire it into the NN by having a special one-hot vector or something, you simply inline it into the dataset itself, as a text prefix, and then let the model figure it out. If it's at all good, like a char-RNN, it'll learn what the metadata is and how to use it. So you get a very easy generic approach to encoding any metadata, which lets you extend it indefinitely without retraining from scratch (reusing models not trained with it in the first place, like OA's GPT-2-1.5b), while still controlling generation. Particularly with GPT-2, you see this used for (among others) Grover and CTRL, in addition to my own poetry/music/SubSim models.

>>joefou+Tl
Interesting! I got a different result for "crowdsourced". https://www.thisworddoesnotexist.com/w/crowdsourced/eyJ3Ijog...

>>tasoga+CZ1
I think people here are missing what you're saying because it is subtle. Which is correct. That "troy" is different from "tor•y". "y" should be the suffix. Just like how "fix•ed" would be different from "fi•xed". "y" is the suffix like "itch" vs "itchy".

What this means, building off of what the evidence I gave, is that this model is not learning the morphemes (smallest root meaning). This exact characteristic is part of why these words sound weird. It is the same problem as the one brought up by tasogare.

[0] https://en.wikipedia.org/wiki/Morpheme

>>Cathed+d32
Typically they have a root to them. There are words that don't and are made up, like yeet (which I'll consider a word because of its usage and common knowledge), but other words like "microscope" are are derived from Latin or something else. The example here is from microscopium. There's a lineage and things modify more slowly (slang typically moves faster but also rarely stays in the lexicon long term). Many words are portmanteaus or compounds, like heelback (heel + back). How words are composed is called Morphology[0]. I mentioned in another comment morphemes. Let's look at transgate. We have trans+gate. Trans is a loan word from Latin meanings “across,” “beyond,” “through,” “changing thoroughly,” “transverse". We know what a gate is, but it can also be like a block (gated) or in a circuit (which is like a door). Here the model is taking the morpheme "trans" and using it as if it is "transaction". But in "transaction" the word makes sense because it is through an action (the word started from the meaning to do business and because this often means exchanging money, that's how we now think of it).

So "transgate" also sounds weird because it has opposing ideas. "through" + "block". But we need to look at morphemes to see why. At least (IIRC) it made this word a verb.

[0] https://en.wikipedia.org/wiki/Morphology_(linguistics)

>>godels+Gw3
You are on to something there. For the syllables I'm actually using a rule-based model from Python's "pyhphen" library: https://pypi.org/project/PyHyphen/

I am not totally happy with the results but have not had a chance to train my own