MMO game Sea of Thieves is amazing so far. Two days in and so far we found treasure, smashed a few skeletons, sailed with an allied fleet of two galleons, and set off some fireworks.
I am currently microblogging on Mastodon: @jd7h@fosstodon.org.
2026 2025 2024 2023 2022 2021 2020 2019 2018 2017 2016 2015 2014
MMO game Sea of Thieves is amazing so far. Two days in and so far we found treasure, smashed a few skeletons, sailed with an allied fleet of two galleons, and set off some fireworks.
Replying to @JanelleCShane
More AI-generated Christmas entities we look forward to every year.
https://www.aiweirdness.com/christmas-entities/
maybe all the nft enthusiasts just really missed adopting those baby dragon jpgs in the 90s, and you gotta say, yeah man, make a webring and a guestbook, it'd be healthier
boosterprikdeltavariantdoorbraakinfectiefinfluencergevoeligheidslezergrotsyndroomintimiteitsvacuümmemeaandeelpandemocratieprikpolarisatieprikspijtqr
Reminder that preprocessing user-supplied data is never trivial. https://twitter.com/nos_nieuw/status/1473240612442976258
It’s my last week at the university, and this mysterious package suddenly showed up in my home office today... 👀
Replying to @jd7h
The package contained 2 boxes of Story cubes, a present from HMI’s NLP group. ✨
I came across a colony of students down in the tunnels under Ramsgate library. Their eyes had become accustomed to the dark, and each of them wore a Primark t-shirt with a humorous slogan.
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
abs: https://arxiv.org/abs/2112.10741
Samples from a 3.5B parameter text-conditional diffusion model using classifier free guidance are favored by human evaluators to those from DALL-E
Boomer generation this, millennial generation that...what about the procedural generation?
Replying to @SecBert
@SecBert Cute! We need more cat pics. ;) Now, for throwback Tuesday, this photo was taken 10 years ago. Look at that babyface!
This is the best thing I've read all year. It is incredibly good and important reading and I recommend it even if (especially if?) you don't work in/around/on games.
https://medium.com/@betterthemask/white-protagonism-and-imperial-pleasures-in-game-design-digra21-a4bdb3f5583c
I am deeply impressed by this long-read by @betterthemask. It definitely has impacted the way I view NLP/NLG and games, including my own research work. Can't wait to explore indie game Sable now... https://twitter.com/mtrc/status/1468679859413131269
This is the best thing I've read all year. It is incredibly good and important reading and I recommend it even if (especially if?) you don't work in/around/on games.
https://medium.com/@betterthemask/white-protagonism-and-imperial-pleasures-in-game-design-digra21-a4bdb3f5583c
Just in time for the new year: a line-printer Snoopy calendar for 2022!
The gift for the Real Programmer in your life.
We are distributing these on behalf of @ef1j95, who used vintage hardware, software, paper to craft an edition of 10 numbered copies. https://www.aleator.press/shop/p/snoopy-calendar-2022
One of these 10 cuties is on its way to our home, thanks to @mrngm https://twitter.com/aleatorpress/status/1468306800902475781
If you're doing #AdventOfCode and learning stuff, but your code's a mess, you got the wrong answer, you're a few days behind, it took you several hours, you're in a language you're not familiar with...
All I hear is that you're learning stuff. You're doing great!! 🌟❤️🎄🧑🎄
A blogpost about biases in recommendation AI led me to this useful list with actions you can take to get away from addictive tech platforms and recommender algorithms: https://www.humanetech.com/take-control.
So far I really like the News Feed Eradicator browser add-on.
Replying to @drtowerstein
@drtowerstein Will do. There will be a livestream on the day itself for people that want to watch the defense remotely!
Huzzah! Yesterday we confirmed the last member of my thesis committee, so now there's a team of 5 experts (NLG! NLP! Games! PCG! Storytelling!) ready to review my 250-page dissertation on flavor text generation for video games. My defense is planned for 25th of March, 2022. 🎈
A youtuber goes looking at some actual cr/ypto games. Unsurprisingly they are all vaporware, shovelware, or artistically dead garbage
https://www.youtube.com/watch?v=YHz0xpU5Tu8
@riesjartnl @freek_janssen @ndrgwrdrdldjs @Snob_2000 @PinguinRadio Nee, maar het is een variatie op https://github.com/jd7h/spotifail, misschien dat je daar iets mee kan knutselen. ;)
Co-worker Tim showed me this beautiful thesis by @TineArts, with a watercolor illustration by Dutch artist Evelien Jagtman.
2 years ago today! My fav is still "Harry Potter and the Problem That Couldn't Possibly Be DNS" -- although "Harry Potter and the harry potter and the harry potter and the harry potter" is also really relevant when working with GPT-2...
https://judithvanstegeren.com/blog/2019/harry-potter-and-the-technical-twitter-meme.html
Replying to @freek_janssen
@freek_janssen @ndrgwrdrdldjs @Snob_2000 @PinguinRadio Een Python-script dat jullie keuzelijst inleest vanaf de website, en daarna dmv de Spotify API (1) een nieuwe playlist aanmaakt, (2) alle nummers uit de keuzelijst (titel + artiestennaam) opzoekt in de Spotify database en (3) de gevonden nummers toevoegt aan de playlist.
Replying to @jd7h
@freek_janssen @ndrgwrdrdldjs @Snob_2000 @PinguinRadio De Spotify zoek-machine is wel een beetje "dom": als jullie schrijven "Ayreon – Day Seven: Hope (Come Back To Me)" dan snapt Spotify niet dat dat hetzelfde is als "Ayreon - Day Seven: Hope". En het heeft ook moeite met specifieke remixes, versies of uitvoeringen.
Hey leuke mensen van @ndrgwrdrdldjs, @Snob_2000 en @PinguinRadio, ik heb (geautomatiseerd) aan Spotify gevraagd om een playlist te bakken van de Snob 2000 keuzelijst voor 2021. Voila: https://open.spotify.com/playlist/7jjI4GTgXwKC3hLPZFv4kj?si=GbQE71O2TbOpqXdPjOJlng
iGGi recruitment '22: if you're thinking of doing a #PhD in #DigitalGames come to our
iGGi TASTER DAY - MONDAY 22 Nov '21 online.
It's not too late to register here: https://forms.gle/oDUXpXTJUp27G4ZW9
This haiku generator also generates "auto praise" for generated artifacts. :') Did we just find an example of "framing" in the wild? https://www.poem-generator.org.uk/haiku/
Replying to @mtrc
I like to think I take (very silly, very minor) action against stuff like this by exploring better ways to build AI. It's a bit naieve probably - I could be doing more? But I think I sleep more soundly at night. Unless my brother is running the blender again 150 miles away.
I love this query-answer example. We need more tweets like this -- it's a tangible demonstration of how these models go wrong in interpreting inputs. Maybe that's the best remedy against overhyped AI: crowdsourced "fuzzing" of opaque models. https://twitter.com/mtrc/status/1456390210724446214
It has been two months since the death of my dear, canine best friend, Pepys.
Today I am releasing “Arf Magna,” a small free software poem/artwork dedicated to his memory and based on the work of Ramón Llull.
https://nickm.com/poems/arf_magna.html
New business idea: company that does pentesting/fuzzing on production-grade deep learning models. Surely this already exists?
TIL "AI" stands for "Angered Italian" https://real-italian-coffee.herokuapp.com/brain (That would explain the scientific success of our joint projects, @lorgatti)
Finding the fun in doggo packed photography game, Pupperazzi
"As for character design, we wanted to keep the shapes simple and stylized for readability -- it was important that people see the things they love about different dogs in our models.”
https://www.gamedeveloper.com/design/Finding-the-fun-in-doggo-packed-photography-game-Pupperazzi
How did I miss this game!? It's Alba: a Wildlife Adventure (low poly game with photography) but with dogs!? https://twitter.com/gamedevdotcom/status/1455565363735711745
Looking at NFTs, I can't help but think almost daily, "plenty of people saw that Tulip Mania was ridiculous, even at the time, but it still took 3 years to collapse"
this one's probably also historically significant. so get those jabs in soon & maybe a historian will quote you.
Replying to @ckaiwu
@ckaiwu But where do you get the age (category) data from? Twitter does not share age or date of birth of users via their API, AFAIK.
Replying to @ckaiwu
🧘 Millennial Brands
Millennial (and Gen Z) spending power is on the rise and investors are seeking to benefit from this tailwind.
We categorize brands as Millennial, Gen Z, or Boomer based on the demographics of their Twitter followers.
Dissertation writing mood. https://twitter.com/threat_update/status/1447547334531891205
"One of the biggest mistakes in the area of game analysis has been the fact that researchers have consistently drawn conclusions and made ‘analyses’ of games they have not played. In order to avoid this mistake, playing Diablo and WoW was planned for as part of the methodology."
Replying to @jd7h
Crap, I should REALLY have read this in my first year. Missed this glorious chance. ;)
Replying to @jd7h
Quote from "Developing a methodology for corpus-based computer game studies" by Carrillo Masso (2009). https://bit.ly/3DKXnt4
I'm reading a 36 page journal paper about "morphological and onomastic characteristics of toponyms in The Elder Scrolls". Translation: linguistic properties of fictional place-names, such as the Dwemer ruins and ancestor tombs in Morrowind. I love my job. https://bit.ly/3DMcLp1
I was reading Nigel Slater's Kitchen Diaries, but after ten pages of lavish October feasts I couldn't take it any more. Now I'm eating toasted sourdough bread with olive oil and a few chunks of goat cheese. This book is dangerous!
Replying to @jd7h
Other side-effects include obsessively searching for local butcher shops, translating obscure vegetable names from English to Dutch and silently moving large amounts of money from 'savings' to 'groceries'.
Another classic video game that has influenced procedural content generation: Ham(m)urabi (1968)
https://www.acriticalhit.com/sumerian-game-most-important-video-game-youve-never-heard/
If you like @rustlang so much, stop trying to hire all the active Rust team members to work on something else. Sponsor us instead! ✨💶
"We love Rust and your work on the language and standard libary, so how about you quit doing that?" —Startup founders in all of our inboxes. 🙄
This Guardian article (2003) describes the procedural planets in Elite (1984), a classic example in procedural content generation. https://www.theguardian.com/books/2003/oct/18/features.weekend
We're hiring a software engineer to help us build the platform that supports our multiplayer AI-narrated story game! https://hiddendoor.notion.site/Software-Engineer-Platform-0cadf362d70849b4a1a49b24f9b9e08d
Hi friendly nerds! Love working on hard technical problems for a ✨magical✨ product with a great (fully remote) team? We're hiring a software engineer to work on our game platform!
https://twitter.com/hiddendoorco/status/1442929950391160832
@joynessthebrave @SketchesbyBoze @Iconawrites I watched Howl’s Moving Castle and Lark rise to Candleford recently, and I’m now reading Piranesi. Thank you for all the great tips you put out on Twitter!
📢 i’m on the market for tenure-track faculty jobs!
i build human-centered AI systems that support creativity, especially in the domains of interactive narrative & game design
is your department hiring? let me know!
https://mkremins.github.io
Apparently, Twitter is now only for people who (1) can recognize chimneys in cropped photos (2) own a phone (3) consent to obligatory, unannounced and unpaid crowd-worker tasks by large social media platforms.
Replying to @tomgauld
@tomgauld @templarbooks @HolidayHouseBks @NealPorterBooks @LEGOIdeas I know you meant the /book/ is available in all good bookshops and online... but I would also love to buy the tiny Lego robot for my office <3
UK friends! I have three copies of my zine of notes and sketches "The Book of Logs and Robots" to give away. Follow me, retweet the tweet quoted below ⬇and you may be randomly chosen to get one. https://twitter.com/tomgauld/status/1433359858212954113
Look at that cute tromp l'oeil zine cover! https://twitter.com/tomgauld/status/1433421214953852931
Talking with students & others the past few days has brought some clarity to the ways in which the LLMs & associated overpromises suck the oxygen out of the room for all other kinds of research.
1/
Frankenstein is a cautionary tale about a guy who creates and deploys a decision-making neural network without ethical consideration, then abdicates all responsibility when he realizes how bad his architecture is and that real-world implementation was way messier than expected.
Tom Gauld's drawings in full colour 😍 https://twitter.com/bookgiftblogger/status/1428457119225950215
I'm writing my conclusion now, and I feel the best part of my thesis is the ideas for future work. Not sure if this is a very good or very bad sign.
While I was searching for screenshots of Torchlight 2, I found this database of game interface screenshots. Pretty cool, and a nice source of inspiration for UI nerds. :) https://interfaceingame.com/
Replying to @hanno
@hanno I read children's books and graphic novels!
Alright, so inspired by @NPurkeypile's bee post yesterday, here is one of my favorite bits of Skyrim oral history - the myth of the treasure fox.
I've told this story before in talks/etc, but I don't think I've shared it with twitter. Here goes.
Dissertation writing mood. https://twitter.com/threat_update/status/1422089356492386306
Diving into the SW:KOTOR game internals again, as I'm reviewing my work on game corpora for my thesis. Turns out that in KOTOR, characters are only allowed to flirt if they are of the opposite gender as the flirtee, and have high charisma.
Dissertation writing mood. https://twitter.com/tomgauld/status/1424313911780708354
So @annetropy, I know your professional opinions on cats and dogs, but how do you feel about birds? https://twitter.com/SketchesbyBoze/status/1423653840818216962
I’m just a blind girl, standing in front of tech twitter, asking you to describe images.
That’s it.
No demands, nothing unreasonable, just a request to tell us blind folks what is in your pictures so we can enjoy them too.
(I’ll even show you how to do it 👇)
Yay, #fdg21 has started! It's great to see all the usual suspects at the Discord server. I've spent this morning pre-recording my talk... and hoping that the sounds of leafblowers, road works and neighbourhood kids are not too prominent in the background.
Replying to @drtowerstein
@drtowerstein Thanks! It's prerecorded so you can watch it after your vacation as well, instead of working during your days off. ;) Worklife balance is important!
Replying to @jd7h
@drtowerstein And of course you can ask questions via Twitter as well.
I forced an AI to paint a Bob Ross painting of Bob Ross painting Bob Ross paintings. This is the happy little accident ❤
Playing around with image generation using BigSleep, for the haiku poem about a jumping frog by Matsuo Basho.
The old pond
A frog jumped in,
Kerplunk!
The new ACM TAPS workflow is not working very well so far... Helpdesk unresponsive, TAPS dashboard stuck at 'helpdesk will contact you within 24 hours' for 3 weeks, and now that I've finally received a fixed HTML proof, I can't mark it as accepted it in the online TAPS dashboard.
Replying to @jd7h
But there is hope. My co-author's name is now spelled properly, with an "ś"!
Fun blogpost about generating haiku using GPT-2. https://www.brianweet.com/2019/06/16/write-ai-gpt-2-haiku.html
CLIP+VQGAN users often add specific art/photography keywords to their prompt to improve the quality, the most common being "trending on artstation" and "unreal engine"
i wanted to see if there were other viable ones. i came up with 64 and made an initial test: just the keywords
I'm writing a thesis section about the various problems and limitations of GPT-2 today. This report by OpenAI is a worthwhile starting point. https://arxiv.org/abs/1908.09203
Replying to @alicegoldfuss
@alicegoldfuss Here among my trappings and belongings, I am home~
https://youtu.be/yVmtG9_55F0?t=61
'Metamorphosis’ is one of four new limited edition prints available on my site now: http://tomgauld.com/shop #kafka #insect #workingfromhome
Midnight googling for the origin of hacker cocktail 'Tschunk'. I found the first (?) recipe for Tschunk on a Gulaschprogrammiernacht (GPN) blog from 2006. https://chre.kocht.gulasch.myblog.de/chre.kocht.gulasch/art/3746170
Just played through the demo for Terra Nil, and I love it. So many games are about exploiting the world of its resources, but this is the complete opposite. Am I allowed to recommend a game after only playing a demo? https://twitter.com/devolverdigital/status/1405247418522910725
Where are all these wholesome games coming from all of a sudden? I love them, and there are not enough hours in the day. https://twitter.com/jellyscrub1/status/1405456751961411584
@maxkreminski Reminiscent of your gardening games idea at FDG 2018? https://www.eurogamer.net/articles/2021-06-16-broforce-devs-world-regrower-terra-nil-is-blooming-marvellous
Announcing WAYFINDER—a relaxing 'art game' in your browser that combines illustration, procedural generation, and computational poetry. 🍃 Produced by @thenfb.
Explore an animated landscape to recover nature's lost memories and build Haiku-like poems.
👉 https://wayfinder.nfb.ca/
Replying to @LangTechLara
@LangTechLara Congrats! I have a master student working on coherence & stories atm (apart from my own dissertation work) so this is welcome reading material. :)
Replying to @btwsl
@btwsl My latest paper as a haiku:
GPT-2 read
many World of Warcraft quests
to help humans write
Replying to @btwsl
@btwsl My latest paper as a haiku:
GPT-2 read
many World of Warcraft quests
to help humans write
If I could re-do my PhD and start in year 1, I would write journal papers instead of conference papers... Conferences are fun, but cramming multiple experiments in 8 pages just doesn't do them justice.
Replying to @jd7h
Maybe we should just ditch the 'A PhD student can only go to a conf if they get a paper accepted there' rule?
In 1985, a mysterious group of women calling themselves the "Games Mistresses" released the first of a series of text adventure games. The story behind their creation is the wildest one you'll read today. #50YearsOfTextGames
https://if50.substack.com/p/1992-silverwolf
"To open the frozen door and claim the honeycomb inside, you’ll need to find an old woman to spin you a pair of mittens out of wool from undersea sheep." https://twitter.com/aaronareed/status/1400449188471660544
Replying to @tomgauld
@tomgauld @newyorktimes @puddygreen @Heart_Agency @tomgauld Can we get more macro-shots of the contents of your bookcase? ;)
Guess the book from the top n words
dream, fire, art, feeling, creative, hear, yes, worksheet, passion, walk, strength, coach, session, burn, bring, feel, earn, exercise, drive, service, trust, get, wait, vision, enthusiasm
Hundreds of nonsensical computer-generated articles, spotted years after the problem was first seen, could lead to a wave of retractions. http://www.nature.com/articles/d41586-021-01436-7?utm_source=twt_nat&utm_medium=social&utm_campaign=nature
A 🧵 of AI-generated images using Caves of Qud wall descriptions as their text prompts (via BigSleep, all first-try)
To start, limestone:
"Invertebrate life was sucked of its tissue and bled still over millions of years. The glaucous rock is a necropolis."
Interesting research by @ckaiwu
https://alphaarchitect.com/2021/05/06/text-based-factor-investing/
Reminder - before you start hosting data in the cloud, look up what it costs to get that data *out* again. This graph represents 8 euros/hour (at ~240Mbit/s).
Replying to @lorgatti
@lorgatti @_dmh Yes, I have the same experience. :(
Replying to @_dmh
@_dmh I have sent a message to Support, we'll see what happens. To clarify: I can still access results from previous experiments, but I'm not allowed to start new jobs -- I only receive the fatal error after setup (meh). AFAIK I never had a Figure8 subscription, so this is unexpected.
Soooooo it seems I'm in the market for a new crowd-source platform. What does everyone use for their NLG/PCG evaluation experiments nowadays?
I'm trying to continue with a crowd-sourcing experiment in Appen (previously CrowdFlower/Figure 8), but despite ample funds in my account, the platform suddenly complains that my "subscription has expired". :/
Never underestimate the power of first-year computer science knowledge. https://twitter.com/sweis/status/1390374132265537548
Replying to @jd7h
I have just received word that the technical term for this phenomenon is 'Buffett overflow' or 'stonk overflow'. :')
Seeing procedural art on Twitter always gives me sweaty palms and makes me want to drop all my existing projects and rush off to learn the newest equivalent of Processing.
Making generative SVG characters inspired by my son’s creations! ✨ Hat tip to @georgedoescode for the tutorial
How it started | How it’s going with zoom
#EconTwitter #AcademicChatter #academiclife #AcademicTwitter #phdlife
Replying to @myrthereuver
@myrthereuver Yes, it's mentioned in his autiobiography as well. I believe Russell lived until the age of 98. He changed his views, opinions, politics and lifestyle frequently during his lifetime, and made a few big mistakes too. In the book he does not hesitate to reflect on his past.
I'm reading the autobiography of Bertrand Russell today. This is what he wrote about his experiences with writing his fellowship dissertation, which he wrote when he was 21...
I can't articulate why, but this NYtimes article gave me a foreboding feeling. "For writers who don’t like writing—which, in my experience, is nearly all of us—Sudowrite may well be a salvation."
Sudowrite is built on top of GPT-3.
https://www.newyorker.com/culture/cultural-comment/the-computers-are-getting-better-at-writing
Replying to @jd7h
Maybe it's these lines: "But what is writing this? Who is writing this? In a sense, Coleridge wrote it. He articulated the pathways of its manufacture."
A GPT-3 generated poem generated from one line of Coleridge as a prompt, however sophisticated, is not "written by Coleridge".
Replying to @jd7h
Correction, the article was published in the New Yorker, not the NYTimes.
Replying to @jd7h
Societal enthusiasm about applications of AI and large language models: great. But the view that GPT-3 (by some high-tech magic) can create high-quality text, consistently and effortlessly, for any creative task, is just too optimistic.
Replying to @jd7h
This view is not explicitly part of the article, I know. But the author spends only a few lines on the caveats of a large model trained on a part of the internet. The internet, which can be a bit like a public bathroom at times.
Replying to @jd7h
If the majority of people views AI-generated content as an extension of the human who used the AI, as something with common sense and intentions, it could be dangerous to society.
Replying to @jd7h
I love to see GPT-3 used for creative writing, but it's becoming overhyped to the same extent that blockchain technology is overhyped. It's not a silver bullet and it has some serious drawbacks.
Replying to @jd7h
I don't think GPT-3 can generate Literature: Charles Dickens and Victor Hugo tried to address societal problems with their writing. Tolstoy wrote about complex human emotions + experiences. Large language models can't do that, even if you train them on every novel ever written.
Replying to @jd7h
If you like this topic, this excellent blogpost by @mark_riedl is also worth reading. https://mark-riedl.medium.com/ai-democratization-in-the-era-of-gpt-3-8b91891f91cb
I'm reading TVTropes this Saturday morning, and I learned a new word! https://tvtropes.org/pmwiki/pmwiki.php/Main/SesquipedalianLoquaciousness
If you're interested in narrative generation, be sure to read the survey on computational narratives by Kybartas and Bidarra (2017). It has definitions of core terms and provides a nice framework for story gen systems based on two axes 'plot' and 'space'. https://repository.tudelft.nl/islandora/object/uuid:0e967ade-b728-4c3f-b3bd-5b89a35b8e2b
Replying to @jd7h
I wish I'd known the difference between narrative, story, discourse and plot when I started out three years ago. Most research papers don't contain the basics, so it's very useful for a research field to have newcomer-friendly, well-written survey papers. :)
It's Sunday, and LudoNarraCon is on! Hold my cappuccino while I download a subset of the 34 playable demo's. :3
Replying to @jd7h
I played 4 demos in 3 hours: Game Director Story (project manager & HR simulation), The Invisible Hand (stock market mystery), Forgotten Fields, and Nuts (90s biology research assistant sim with video camera's and pop art graphics).
no I do not "tweet too much" I am creating primary sources for future historians
So games research Twitter mentioned Blaseball at some point, and now #LudoNarraCon is sponsoring a "blaseball season"... I think it's time to find out what Blaseball is, and see what the fuss is all about.
LudoNarraCon, an online celebration of narrative games, starts this Friday! It runs from April 23 to April 26 with all kinds of cool activities on Steam. Looking forward to all the demos! More info here: https://www.ludonarracon.com/
Replying to @jd7h
I cannot stress enough how much I love this event. If you like narrative-driven games, be sure to join this weekend. It's online and freely accessible. I attended last year by playing a few of the demos and ended up buying multiple games because I loved the demos so much.
Replying to @jd7h
The exhibitors are mostly indie devs, and the games are unlike anything you normally see: their stories explore interesting themes (privacy, diversity, politics, societal issues) and the games often have really interesting art styles as well.
Replying to @jd7h
I remember at COG 2019 (an academic games conferences I attended pre-COVID), some of the games that were showcased at #LudoNarraCon were the ones that everyone kept recommending to each other!
I am pretty sure this can be built with some basic NLP magic. Sounds like some good thesis procrastination... https://twitter.com/twisteddoodles/status/1382955169650970630
New blogpost: Networking tips for your first conference (aka the blogpost I wish I had in 2016)
Thanks to @WEareTROOPERS for the great conf experience. <3
https://judithvanstegeren.com/blog/2021/networking-tips-for-your-first-conference.html
This post has nice visualisations of encoder-decoder architectures and attention mechanisms:
https://jalammar.github.io/visualizing-neural-machine-translation-mechanics-of-seq2seq-models-with-attention/
Haha, one of my tweets ended up in a fun blogpost by @IrisVanRooij: https://irisvanrooijcogsci.com/2018/12/21/can-a-brain-think-a-finite-or-infinite-number-of-thoughts/
Humor in the footnotes of the original GPT-2 paper by OpenAI, in a section about evaluating GPT-2 on a question answering dataset. GPT-2 scored pretty bad with an accuracy of only 4%, which is 5 times better than its predecessor GPT. The (human) first author scored 17%. #nlproc
"At present (1958), able men are attempting to harness electronic computers to establish “input-output” series of sufficient intricacy that perhaps at some future date it may be possible to know with a fair degree of precision what the coming business trends will be."
Replying to @jd7h
A quote from Common Stocks and Uncommon Profits (1958, p. 203), in which Philip A. Fisher talks about economic forecasting.
Replying to @jscherpe
@jscherpe @datakami_nl What's an FSI enterprise?
I've been thinking a lot about my post-PhD career lately. My contract ends in December, after which I'll work @Datakami_nl fulltime... but what kind of projects should I contribute to and why? I'd love to do something meaningful with my skills within infosec, NLP and/or finance.
Replying to @jd7h
@datakami_nl I'm thinking along these lines:
- use text processing (NLP) to analyze ESG criteria in public companies, e.g. gender equality like @equileap does
- use text generation to generate better & faster security reports
- use NLP to process security reports for faster monitoring
- ???
Replying to @jd7h
@datakami_nl @equileap If you know about companies or people that do something like this, let me know!
Fun! Researchers of @DNB_NL performed sentiment analysis on @FD_Nieuws articles to get macro-economic sentiment for the Netherlands, which is faster than waiting for reports by Statistics Netherlands (CBS). You can read the pub here (via the first author): https://jasperdewinter.github.io/pp/files/DeWintervanDijk_2021.pdf
This project is a glorious combination of some of my personal interests: data mining, text mining, NLP, sentiment analysis, investing, stock market sentiment, and finance. https://twitter.com/jd7h/status/1376908914265100291
Fun! Researchers of @DNB_NL performed sentiment analysis on @FD_Nieuws articles to get macro-economic sentiment for the Netherlands, which is faster than waiting for reports by Statistics Netherlands (CBS). You can read the pub here (via the first author): https://jasperdewinter.github.io/pp/files/DeWintervanDijk_2021.pdf
Replying to @jd7h
@DNB_NL @FD_Nieuws BTW this is a short, 4-page publication in Dutch, in a magazine for economists, which highlights the method and main findings. Publishing a peer-reviewed academic publication is still in progress, according to the interview with the 2 authors in FD: https://fd.nl/weekend/1377204/dnb-onderzoek-het-fd-voorspelt-de-economische-trend-in-nederland
Replying to @florianoverkamp
@florianoverkamp Yes, but established domain-specific lexicons don't change overnight, esp. in research. If you reuse the old lexicon for new research, it is easier to compare your results. And industry generally does not publish their lexicons.
Replying to @florianoverkamp
@florianoverkamp To be honest, I expect sentiment analysis for finance is done with sentiment word lists (which is more transparant than black box sentiment analysis with deep learning), and then you can skew the analysis result by simple word substitution.
Replying to @jd7h
@florianoverkamp Just substitute each 'bad' word with a synonym that is not in the list, or rewrite sentences that trigger a negative rating in the sentiment analyzer.
Replying to @florianoverkamp
@florianoverkamp https://www.nber.org/digest-202012/corporate-reporting-era-artificial-intelligence
Replying to @jd7h
@florianoverkamp "Companies go beyond machine readability and manage the sentiment and tone of their disclosures to induce algorithmic readers to draw favorable conclusions about the content. For example, companies avoid words that are listed as negative in the directions given to algorithms."
And again I turn to the Internet Archive to find classic-but-hard-to-find-papers. This time, "Building applied natural language generation systems" (1997) by @EhudReiter and Dale. Link: https://web.archive.org/web/20180508125249/https://homepages.abdn.ac.uk/e.reiter/pages/papers/jnle97.pdf
Replying to @JurieHorneman
@JurieHorneman Nope, I'm not familiar with it.
To celebrate #GCW2021, we teamed up with @DigSchoolhouse and artist @MonkeysvsRobots to create this epic games careers poster and flyer for schools.
And it's completely FREE to download and print!
🔥 http://bit.ly/3rw5DH3 🔥
Recently I read research that shows that once researchers started publishing about sentiment analysis on annual reports (and investors started trading based on automated text analysis) companies slightly adapted their language to push the algorithms to more favorable conclusions.
Last Saturday, Dutch newspaper FD reported about sentiment analysis research on news articles to automatically assess the economy. Now one of their journalists has written a news article titled 'Dear Algorithm' addressed to the sentiment analyzer. :D
https://fd.nl/opinie/1378588/beste-algoritme
Replying to @UTwente
@UTwente Wat als je geen Facebookaccount hebt? Kan ik deze belangrijke info ook op een andere plek dan een Amerikaans advertentieplatform vinden?
Just found out that one of the academic lexicon's I've been working with was published under a Creative Commons, No Derivatives license, which seems a bit silly to me. Why release an academic dataset and not allow other researchers to build upon it?! https://creativecommons.org/2020/04/21/academic-publications-under-no-derivatives-licenses-is-misguided/
I'm writing the background section on NLG now, and I've gone back to the basics, such as template-based NLG. It's fun to read this paper (1995) by @EhudReiter, in which he discusses 'real' NLG vs templates: https://arxiv.org/pdf/cmp-lg/9504013.pdf. Related blogpost: https://ehudreiter.com/2016/12/18/nlg-vs-templates/
you think writing a phd is about research but actually it's about learning 180 synonyms for the word "explore."
explore argue discuss explain assume state pose observe introduce investigate focus research question criticize compare contrast adapt improve build develop propose https://twitter.com/joynessthebrave/status/1359913687335792640
Schrödinger's final year PhD student: when you send off a chapter draft to your supervisor, and feel both proud and horrified at the same time when you re-read the words you've written so far.
My cartoon for yesterday’s @guardianreview. Many more of my @guardian cartoons are here: https://www.theguardian.com/profile/tom-gauld
(NL) Hihi, ik heb een nieuw woord geleerd: "gewichtigewartaalmachine" https://www.nrc.nl/nieuws/2021/02/26/artikelrobot-scigen-slaat-toe-met-nieuwe-wartaal-a4033449
It nice to read papers that are different from my usual fare. In this paper, Michael Straeubig comments on the public discourse on video games and AI, while referencing a whole bunch of interesting people and projects: https://eludamos.org/index.php/eludamos/article/view/vol10no1-9
Replying to @jd7h
He also describes the various roles AI can fulfill in the context of games: "Mechanic, Alter/Ego, Observer, Protector, Player, Creator," and (speculatively) "God".
This is still one of my favorite procedural content generation papers: "Analysis of ReGEN as a graph-rewriting system for quest generation" by @QKybartas and Verbrugge (2014) http://gram.cs.mcgill.ca/papers/kybartas-14-analysis.pdf #procgen
Replying to @jd7h
It's about ReGEN, a narrative/quest generator with graph rewriting. The authors also describe metrics for analyzing branching narrative graphs, and compare their outputs w/ SQUEGE, Skyrim's Radiant generator, and main quests of Skyrim and The Witcher.
Replying to @mtrc
@mtrc @ChristophSalge With great power comes great responsibility. ;)
Jason Boog describes how he uses GPT-2 for long-form creative writing. https://towardsdatascience.com/how-to-fine-tune-gpt-2-so-you-can-generate-long-form-creative-writing-7a5ae1314a61
Replying to @mtrc
@mtrc When I gave a talk about social media use at my Uni, I just told them, do whatever Mike Cook does. ;-)
I also cited some nice work by @jd7h though.
Mood: "I made some painful edits" https://twitter.com/tomgauld/status/1236593347592163328
This is a hard to find but very fun to read paper by Mark R. Johnson about the procedural culture (religion, language, beliefs/politics and aesthetics) of experimental rogue-like game Ultima Regio Regum. #procgen https://web.archive.org/web/20170608190545/http://www.ccgworkshop.org/2016/Johnson.pdf
Replying to @jd7h
BTW this is the paper "Towards Qualitative Procedural Generation" by Mark R. Johnson, 2016, Computational Creativity in Games Workshop.
Google Scholar doesn't have it, and the workshop website is down, but you can find the paper in the Internet Archive: https://web.archive.org/web/20170608190545/http://www.ccgworkshop.org/2016/Johnson.pdf
Valheim is the biggest gaming crack I've come across in a long time. It has everything: sailing (Zelda TWW), building (Lego), exploration (Morrowind/Skyrim), farming (Stardew Valley) and coop monster slaying.
Replying to @jd7h
Instead of hunting monsters and farming metals, I run a ferry service from Our Village Island to Troll Island With Copper Mines and get paid in raw ore. This is the life.
Replying to @jd7h
As soundtrack I recommend Asynje, Kaunan, Forndom and Sowulo.
Reasonably funny paper titles I stumbled upon 🧵
Fantastic Strings and Where to Find Them:
The Quest for High-Quality Video Game Text Corpora
https://judithvanstegeren.com/assets/2008-vanstegeren2020fantastic-preprint.pdf
The call for papers for #CLIN31 is out! The 2021 edition of Computational Linguistics in the Netherlands will take place in Ghent on July 9th. Submission deadline for extended abstracts (3 to 4 pages): April 19th. https://www.clin31.ugent.be/call-for-papers/
A new logo, the first prototype, lots of cool collabs... December and January were good months for Datakami. :) https://t.co/w8I2QHb7WB
Your fellow creatives aren't your competition, that's stupid. They're your hype team, your cheerleaders, your support and guidance. I wouldn't be where I am without other creatives and I acknowledge that wholeheartedly.
Your fellow researchers aren't your competition, that's stupid. They're your teachers (and students!), your mentors, your hype team, your cheerleaders, your support and guidance. I wouldn't be where I am without other researchers and I acknowledge that wholeheartedly. https://twitter.com/MorrighanCorbel/status/1355150608299413510
Dissertation writing mood. https://twitter.com/tomgauld/status/1353293285046026242
Researchers annotated a dataset of video game development post-mortems of @gamasutra!
Pre-print: https://arxiv.org/abs/2001.00491
Dataset: https://github.com/game-dev-database/postmortem-problems
Now I want to poke around in this dataset, instead of writing my dissertation intro...
My ANLP students (team #2) trained BERT on the Star Wars: KOTOR game dialogue dataset to create a sentiment analyzer for Star Wars. They created 2 short surveys to evaluate the sentiment labels mined from the dataset:
https://forms.gle/RyUbSAQNDWPu2PWU6
https://forms.gle/jaDwLsQcqMDbEBbj8 #nlproc
Eastshade is the vacation simulator that I didn't know I needed! It has gorgeous environments and walking and camping and painting and it is WHOLESOME.
Replying to @jd7h
OK I'll admit that it also has its flaws: the game is not optimized for performance; sometimes the animal people are a bit scary; the writing is generally kid-friendly but sometimes unexpectedly switches to dark Terry-Pratchett-esk irony. :')
Replying to @jd7h
Also... did I accidentally cause a parent NPC to be released from parental authority and get separated from their child, because I unknowingly chatted with their meddlesome neighbour!? WHAT JUST HAPPENED
Scientific Programmer https://www.academictransfer.com/297022/ @CWInl
My students have built a DistillBert-based text generator for RPGs Star Wars: KOTOR and Torchlight 2, and they are now looking for people who want to help evaluate their model w/ a survey. Participants are asked to rank sentences on coherence: https://survey.sogosurvey.com/Survey1.aspx?k=SsRPUUYTsQsPsPsP&lang=0 #nlproc
I miss you, dear FDG and COG conference friends! To continue my favorite coffee-break conversation online: my favorite narrative-heavy games of 2020 were Alba and Assemble with Care by @ustwogames, Pillars of Eternity and The Long Dark. What were yours?
This year my online cookbook http://Mosterdgeel.nl will be ten years old! I'm thinking of making a sticker pack of food illlustrations to celebrate it...
Today in "fun academic papers that fit my PhD topic AND video game preferences": https://content.sciendo.com/view/journals/icame/43/1/article-p23.xml
TIL there's a new contemporary translation of Beowulf and I can't wait to read it. The author has translated the first word 'Hwaet!' with 'Bro!'
https://aworkinglibrary.com/reading/headley-beowulf via @aworkinglibrary
As this new year starts, we hope that all of you have been offline for a while, during the holidays, and took some time for yourself.
Now, It’s time to put those newfound energies in something, right? An #FDG21 full paper maybe?😉 The deadline is getting close (25th Jan)!