Writing and ChatGPT

As far back as 2008, Kenneth Goldsmith was saying that, through the Internet, writing had ‘met its photography’ – referring to the supposed crisis painting faced once realistic images could easily be produced. ChatGPT is another part of this long-running crisis, rather than something new.

Like most people, I find the output of tools like Midjourney, Stable Diffusion and ChatGPT miraculous. Being able to put a few words into a system and receive a picture matching that description is incredible. I keep reading claims that ChatGPT can pass the bar exam, or can think at the age of a small child, or generate computer code.

While ChatGPT can produce very good undergraduate essays on certain themes, it is not able to generate spontaneous writing about obscure texts. And while it might be able to create specific examples of code, that is not the main problem in programming. (Describing what a programme should do, and seeing whether it works are far more time-consuming). These tools are remarkable but they cannot easily synthesise new things.

I’ve had a lot of debate with a friend about whether these tools are creative. They definitely do some tasks that would be described as genuinely creative. However, this is a brute-force approach to only one type of ‘creativity’. These models are huge statistical analyses of existing content, a huge multi-dimensional data table. They are not artificially intelligent in the way we normally understand that term, rather they are reliant on a huge pool of imported data.

ChatGPT is very good at is producing styles of writing seen on the Internet. It can automatically generate the sort of text that provoke reactions, but it has trouble producing sustained and detailed texts. This tool will be able to flood the Internet with the sort of writing that already appears on the Internet. It is wickedly good at listicles, short blog posts that seem to say something, and arguments about major franchises.

This sort of language was already being crafted for the Internet. People were writing web copy to fit in with SEO. Buzzfeed was producing headlines that would be popular, and then crafting the stories to fit them. Twitter was promoting a particular style of discourse. The algorithmic ranking of text was a problem long before, because it was shaping the sorts of writing being produced.

ChatGPT arrives at an significant time. More people are reading than ever before, but they have changed what they are reading, moving on from novels and newspapers to smaller pieces of text. This is an fascinating time to be writing stories. ChatGPT is going to make certain types of content worthless (it’s a bad time to be producing small blog posts to increase engagement). It’s time to leave basic writing to the machines and move on to more interesting things.

Writing in 2022

2022 has been a good year for writing, and I’ve had several stories published:

I also published two more volumes in my South Downs Way series: Weird Tales of the South Downs Way and A Foolish Journey. I also launched an etsy shop in January to sell my work.

In April, I joined the Todmorden Wednesday Writers group and have enjoyed the fortnightly writing challenges. I’ve also made some new friends, and was published in their annual anthology.

Also in April, Dan Sumption made a video of his reading of my story A Disease of Books.

I’ve been working at submitting stories this year. I sent out 55, of which 8 were accepted, and 38 rejected. Sending out stories is hard work, since you’re part of an avalanche of slush; and it’s not just about being good, it’s about appealing to a particular editor. And, looking back on the last year, I’ve had more satisfaction from self-publishing than I’ve had from my submissions.

I don’t have a large audience. That’s OK. Of all the writers I’ve met, the one who seemed happiest with their career was a woman who spoke at Slash Night. She wrote about a minor fandom for a group of about 100 people who passed around samizdat novels. The audience was responsive and engaged, and the way she spoke about her career was more passionate than anyone else I’ve encountered.

There’s an obvious question here: do I work harder at submitting my stories, or do I focus on self-publishing?

A major factor here is that the response is better from self-publishing than submissions. It’s great to be published in markets I love, but receiving a personal response to the work means more. I had an enthusiastic review from the Zeenscene blog (“These are affecting tales, well-written and honest, and well worth setting time aside to read“) and, several months into the etsy store, I found my reviews (“all of the stories in the pamphlets are consistently well-written and simultaneously strange and comforting“). It’s not simply about validation, it’s about participation. Some of my published pieces have received little or no response, whereas I’ve loved seeing social media posts about the Mycelium Parish News as readers get their copies.

Sending work out for submission means tailoring my work. Editors provide an important filter for writing, and self-publishing runs a risk by not having this oversight. But, at the same time, not everything I want to write fits into a market. I like the weird pieces. I’m tired of giving stories with a cosy beginning, middle and end. I’d prefer to focus on my own type of strange and aggressive little pieces, and I’m producing more of these than there seem to be markets for.

A third thing: I like producing physical objects. I like putting writing into a container and sending it out into the world. There’s a magic to the postal system. The tiny A7 books of stories I produced a few years back were hard work to make, but they were fun. I’d love to produce more writing like the short story I did on an origami crane.

I don’t want to continue gambling with my happiness, working hard submitting pieces I love to receive form rejection emails. I’d rather use my energy on something that will definitely bring me joy, and that is building tiny publications. My design skills might be rudimentary, but they are tighter than some of the online magazines I’ve found myself submitting to. And, you know, if I decide to produce several thousand words of Death Stranding fanfics, self-publishing means I can find them a home.

So that’s my plan for 2023, to focus on zines and postal experiments. Most of this will be fiction (I have two more South Downs Way zines on the runway), but there may be some non-fiction work too. I’m not 100% sure what else I will focus on, and that in itself is exciting.

Some links on ARGs

At the start of November, I ran a seminar for a university transmedia course on ARGs, Alternate Reality Games. I was looking specifically at examples of three ARG-like projects had been taken as real, with disturbing effects. This post lists some of the links that I referred to. Another will follow with some thoughts on ARGs.

  • An excellent introduction to ARGs is the 50 year’s of Text Adventures series on The Beast, a 2001 ARG written to promote the Spielberg movie AI. This was the first major ARG.
  • I referred to a number of ARGs in my introduction. Majestic, from Electronic Arts, came out shortly after the Beast and was an interesting failed experiment. One of the most successful high-profile games was Why So Serious? (2007), promoting the movie The Dark Knight, which included phones hidden inside cakes.
  • Although I didn’t refer to it in the session, I loved the Wired magazine interview with Trent Reznor discussing how his band Nine Inch Nails made an album, Year Zero, based around an ARG. I also came across some fascinating references to EDOC Laundry, a clothing line that was also an ARG.
  • Perplex City was another successful ARG, run by a team including Adrian Hon. One of the puzzles form Perplex City was only solved after fifteen years. Some excellent background on Hon is in a 2013 interview, Six to Start: Foundation’s Edge.
  • It’s interesting how ARGs provoked so much interest, but have not broken through to the mainstream. Alternate Reality Games Could Still Take Over the World (And Your Life) was a good article discussing this. It quotes ARG designer Andrea Phillips: “A lot of energy has [transferred] into lightly interactive web series, room escape games, narratives-in-a-box. Things that use a few of the ARG tools (tangible artifacts, in-story websites, email) but don’t use the full-fledged ARG formula.
  • I discussed the issues around the funding of ARGs, and how difficult that has proved. I also looked at how TV shows like Westworld and Severance have used the ‘mystery box’ concept to build audiences that research and discuss the plots in a similar manner to the communities that investigated ARGs.
  • I then moved on to my three examples, the first of which was Ong’s Hat. Gizmodo produced an excellent overview, Ong’s Hat: The Early Internet Conspiracy Game That Got Too Real. The Ong’s Hat story was created by Joseph Matheny, and his story is excellently told in the two-part Information Golem podcast.
  • Also worth mentioning is Matheny’s involvement in the John Titor hoax.
  • The Slender Man was created for a photoshop challenge, and immediately inspired a number of ARG-like projects. Cat Vincent did an excellent job of summarising Slender Man for Darklore, paying particular attention to the way ARGs contributed to the development of the mythos. Cat also wrote a follow-up article in 2012. I previously used Cat’s research for my talk on ‘Brown Notes’, The Internet Will Destroy Us. Slender Man became a tragic case of ostentation, when two children who were obsessed with the character stabbed a classmate in Wisconsin.
  • I then went onto talking about conspiracy theory, using Abbie Richard’s Conspiracy Chart to discuss the movement of conspiracy theories from (what many people saw as) harmless and silly ideas to dangerous (and often anti-semitic) ones.
  • I used the ‘Birds Don’t Exist’ hoax as an example of using transmedia to promote a conspiracy theory, as discussed in a NY Times article, Birds Aren’t Real, or Are They? Inside a Gen Z Conspiracy Theory.
  • Adrian Hon wrote an insightful article, What ARGs Can Teach Us About QAnon. While careful to draw clear lines between QAnon and ARGs, the piece nevertheless drew interesting parallels.
  • I then concluded by talking about how ARGs often pretend to be real (‘this is not a game’), and the ways in which the lines between real and imaginary can be played with, particularly given how the media has an insatiable need for stories. I talked a little about Chris Parkinson and the film Tusk, referring a 2014 talk where he encouraged people to “Leave your stories lying around in unorthodox, unethical locations”.

The South Downs Way: A Ten Year Writing Project

I’m currently putting together the final few stories for a zine called Once Upon a Time in Brighton and Hove. It’s a collection of microfictions about the town where I lived most of my life so far. It also functions as the sixth volume in my larger series of zines about the South Downs Way.

Earlier this year, I pulled together the work I’d been doing on this series, and it looks as if it will be 20 books written across the 2020s. I’ve got about 80,000 words in notes and sketches for the remaining 14 books, so this is a very achievable aim. (I’m not sure where the idea of the South Downs Way project lasting ten years came from, but it feels right.)

Coming up to a third of the way through the project, I’m starting to realise some of the complexities of such a large project. For a start, there’s the issue of managing all the different threads that are in play. Characters who lead some stories turn up in the background of others; events play out from different points of view. I’ve mostly avoided huge errors, but I have had to quietly rename one character. I also had to change some character’s clothes, when they were wearing Slipknot T-shirts six months before anyone in the UK would have heard of the band.

The Devil, who was the focus of the second zine, has also taken over a little. There is another zine to come (probably around 2025) about his relationship with Jesus. But given how much people seem to like this character I need to make sure his arc has a satisfying conclusion, preferably tied together with some of the other major characters. Is this huge collection of short stories actually a set of short stories about the Devil’s interactions with the South Downs landscape and the people who live there?

Another challenge is working out how best to show the links between the stories. I’m releasing them initially as small A5-size zines, but they will need to be collected at some point. Are the stories easier to follow through time order, or through the location they occur on the South Downs Way? Or a more arbitrary order that makes the connections clear?

At the moment the stories are printed with their location and the name of the main character, but maybe I should have been adding a timestamp so that anyone who wants to can check what order certain events occurred in. That also makes it easier for readers to see where things happened in relation to the weirdness of 2020.

I started writing this series shortly before the pandemic. As I’ve written the first few zines, I’ve avoided mentioning covid. I’d no interest in writing about it, and all the stories I’ve written so far have taken me up to 2019. The most recent volume, A Foolish Journey, looks at one person’s story, but does not follow her into the pandemic. But as time goes on, the stories set in 2019 become further from the present day. Ignoring the pandemic seems less feasible – having all the stories ending just before it seems to beg for an explanation in the text.

I have two zines planned for 2023. The first has a working title of A Haunted (Acid) House Story and is relatively self contained, following Tony from the second summer of love into the 2020s. The other, Stories of Sussex Folklore is about Dr Sally Jones, who walked out of her life as a doctor in Volume 3’s story Dromomania. This one is going to connect to several other characters, and I will need to make some decisions about the larger structure of the series before that one is published.

My biggest surprise is that I’m so excited about seeing this project through to the end. I’ve often been flaky about writing projects in the past, and I think this demonstrates a new focus and determination.

Works of art as places

Nick Cave’s recent long interview with Seán O’Hagan, Faith, Hope and Carnage, is an amazing book. Cave talks frankly about the last few years, and his grief at losing his son, Arthur. He also talks about his working methods, particularly in relation to Ghosteen, his most recent album with the Bad Seeds, leading to this remarkable passage:

Well, I think Ghosteen, the music and the lyrics, is an invented place where the spirit of Arthur can find some kind of haven or rest. Seán, this idea is as fragile and as open to question as an idea can be, but for me, personally, I think his spirit inhabits this work. And I don’t even mean that in a metaphorical way, I mean that quite literally. This isn’t an idea I have articulated before, but I feel him roaming around the songs.

I’m fascinated by the concept of artwork as virtual place (for example, in Alan Moore’s concept of Ideaspace), but Cave takes this a step further, with the idea of an artwork as a place to encounter a spirit that is not accessible in the real world.

Sending out my writing

A while back, I wrote about how my writing has developed through reading Chuck Palahniuk’s discussions of technique. An even bigger change over the last year has been to focus on publication, in whatever form that takes.

Anxiety over sharing my work has long been a problem. It wasn’t the simple ‘fear of success’ that some people talk about, rather a ridiculous fear of negative effects from publication. At the same time, I’ve been driven to write stories since I could first write a sentence, and these two drives have been in conflict. Sometimes I’ve thought I should quit writing stories and focus more on other parts of my life – but quitting didn’t work for me either, so I needed to find another way through.

Since moving to Yorkshire, I’ve put more effort into sending work out. A lot of my old work was written with little thought of an audience. It was fun, and some of that work was great, but you lose rigour if you don’t define yourself against any external standards. I wrote some good stories that I have no idea what to do with. An example of this is a story I wrote called Richey Edwards vs Godzilla, a mash-up of indie music and kaijus. It’s a great piece of writing, but almost wilfully obscure.

Change is a strange thing – it can take years but feel sudden. I’ve been toying with ways to put my work in public for a while. Part of this was attending a 2018 Arvon course with Tania Hershman and Nuala O’Connor, which provoked me into one flurry of submissions. The South Downs Way zine project has been an interesting way to explore publication, and putting recent volumes onto etsy has worked well. In 2022, I have become more consistent with submissions (41 so far this year) and it feels like a significant change.

It’s not as if I am now writing things only so they can be published. I have a huge number of ideas and it is more about working on the ones I feel I can find a home for.

Recently I thought about writing a folk horror piece about offices. It was interesting, in that it took the elements of folk horror and transposed them to a corporate setting. But, at the same time, it was mostly a cover version of The Wicker Man. If I’d worked on this, it would have been competent, but I couldn’t imagine being enthusiastic about submitting it. Long stories take a lot of time, and need to be worth spending so much energy on. In the end, I stripped out the elements of the piece I liked, and it will emerge as a smaller, stranger piece than it would otherwise. I’ve spent too long writing solely for myself, and I need to make up for lost time.

Planning the South Downs Way zines

The South Downs Way is a series of zines containing short stories that I’ve been publishing since March 2020. The individual stories combine into longer narratives about the lives of their characters. I released the fourth volume in January 2022, Weird Tales of the South Downs Way, and the fifth (A Foolish Journey) comes out in July.

I always loved the idea of telling a huge story from a set of smaller stories. One of the inspirations for this is Geoff Ryman’s 1998 novel 253 which is made up of the interconnected stories of passengers on a tube train. Another inspiration is comic books, and the way that huge stories might be hinted at in brief references.

The South Downs Way contains a load of different characters who sometimes encounter each other including a tarot reader, a physicist, and a guidebook writer with a broken leg. There are also ghosts, giants, and the Devil himself, who tangles himself in the lives of the people he encounters on the Downs.

For some reason I had the figure of 200 short stories in my head, of which I’ve published 56, with the fifth volume just about to be published. I’m over a quarter of the way through my arbitrary target, and I recently stopped to take stock and see where I am going.

Things have definitely sprawled a bit with the writing I did in 2021. When I counted things up early in 2022, I had sketches for 146 stories and about 23 different booklets. Not all of these will be viable, but I easily have enough material to produce my 200 stories. In fact, it looked as if I might produce something longer than I had planned.

All these stories need to combine with the other pieces to produce a coherent whole. I’ve been doing a lot of work since on shaping and linking the sketches I have – and I’ve already introduced a lot of elements and characters that need resolving. I also decided to make the upcoming zines more clearly themed so they stand more independently.

The biggest change to the project since starting was selling issues on etsy. I was excited by the fact people were buying copies, and it got me thinking about how to make the future volumes work better. How do I make the stories easier to sell/promote? (Which is not to say I’m changing anything about how I write, more thinking about how I make what I do as appealing as possible).

This project will continue over some years – I don’t want to focus solely on this. . I’ve got one volume with the printers (A Foolish Journey) and two more nearly finished (Stories of Sussex Folklore and Once Upon a Time in Brighton and Hove) so I can take a more leisurely pace for a time. I’m going to try to get one more volume out this year, with the others coming out every six months after that.

Learning from Chuck Palahniuk

One of the books I love most is Chuck Palahniuk’s Fight Club. I read it when I was 24, on the plane home after eight months working a dull contract in America. This was probably the perfect time to read that book.

It wasn’t just the story of Fight Club that I found inspiring. Palahniuk’s writing was sharper and more vivid than anything I’d encountered before. His uses of rhythm, repetition and set-piece scenes were incredibly well-crafted.

Palahniuk has described his writing style at length in his writer’s biography Consider This, outlining a whole toolbox of techniques. Recently, he’s been running a Substack newsletter where he often builds on the lessons in Consider This, and I’ve found myself working more on including some of them in my work.

One example is the use of clear physical actions for the characters. Palahniuk explains that a well-crafted gesture embeds the reader within the story. Their brains will consider the action, activitating the mirror neurones, and Palahniuk sees characters in motion as performing a sort of hypnosis on the reader. Using gestures in my work has also given me a clearer idea of the scenes that I write. I’ve also become more aware of this in my reading. Novels that seem flimsy are often that way because the characterisation comes from dialogue rather than action. Characters need a physical existence.

The other idea is that any piece of prose should include a clock or a gun. There should either be something dangerous that threatens the characters; or there should be some sort of timer counting down, limited the possible length of the story. Both of these add a tension, as well as making the stakes clear.

I’ve been using both of these techniques in my recent writing. At first, this was consciously, asking myself explicitly where these things were in a piece. Now, I can see them emerging as I plan a story. I think my writing is better for it.

Holiday Wardrobe

I recently had a story of mine, Holiday Wardrobe, read by actor Jennifer Aries at the London Liar’s League event. It’s about a disappointing holiday in a magical kingdom.

It’s particularly exciting to have a story selected by the League, as I get to hear my work performed by someone else. When I’m editing, I read my work out and edit it until the text seems to flow perfectly. Another person will take the same text and draw out different pauses and emphasis. It’s an interesting experience.

This is actually my second appearance at Liar’s League, the first one being in 2008, when my story Eat at Lovecraft’s was read by Becky Hands-Wicks. I’ve sent about half a dozen pieces over the 14 years since then, but this is the first one to be selected. Liar’s League is an amazing event, and I’m excited about submitting more in the future.

Using AI as a writing partner

I’ve been curious about GPT-3 as a creative tool since reading about Matt Webb’s experiments in 2020. GPT-3 (Generative Pre-trained Transformer 3) is a language model that can create realistic text. The results are impressive, and it has even been used to write a Guardian editorial. In his experiments, Webb was confronted by phrases and ideas that did not exist before. The model produced original concepts such as the “The public bank of Britain”, and passages about “a three-mile wide black ring [that] was found in the ocean using sonar“.

The GPT-3 model is based upon millions of words of Internet content, and Webb has described elsewhere how “Reading GPT-3’s output, for me, feels like dowsing the collective unconscious. I’ve never seen anything so Jungian.

You can get a quick feel for GPT by playing with the Talk to Transformer page, which allows you to experiment with the basic trained model. There’s a good overview by the Verge, ‘OpenAI’s latest breakthrough is astonishingly powerful, but still fighting its flaws.’ Or, for a more whimsical experiment, Janelle Shae tried asking the model how many legs a horse has, concluding, “It’s grammatically correct, it’s confident, and it’s using a lot of the right vocabulary. But it’s also almost completely wrong. I’m sure I’ve had conversations like this at parties” The origins of the model means it’s also particularly well informed about topics such as Miley Cyrus and Harry Potter.

Sadly, I’ve got no chance of getting my hands on GPT-3 any time soon, since it is kept under tight control to stop it from being used for evil. But then I remembered that Shardcore had used the earlier GPT-2 model for his software-generated book length collaboration with John Higgs The Future Has Already Begun.

I realised that GPT-2 ought to be sophisticated enough to produce something worthwhile, so I decided to give the basic GPT-2 model some additional training based on my creative writing. I’ve read recommendations that you need 25MB-100MB of text, but I’m using 6MB of my writing as input (generated from the source documents using Apache Tika). I was then able to use this with a colab notebook build by Max Woolf to do the hard work.

(I’d not used colab notebooks before, but I am stunned at how they combine workbook and instructions, along with a free VM to run it all on. For more detail, check out Robin Sloan’s post The Slab and the Permacomputer. It’s amazing to see how lots of people’s hard work has combined, allowing me to play with sophisticated models without knowing much about python or machine learning).

The snippets of text generated are identifiably mine in a strange way, but there are flights of fancy that surprise me. A description of a character: “He was a man of his word, not a man of action.” A phrase: “Nobody felt safe watching another human being do something with their lives“. There was a whole mad fantasy about “a group of ‘dusk-blue crabs’ who ’went by the name of ‘the great snout’“. There are also moments where the model just goes on and on repeating “Wax tins! Wax tins! Wax tins!”. Weirdly enough there was also a passage about a John Higgs:

John Higgs, the English economist and writer, died on 26th October, 2001. He was 83 years old. He was happy to join the world scene, and for good reason. He and many of his ideas were burned at the stake for their uselessness.

The main issue I have is my training data, which is unbalanced in various ways – a few novel-length texts, lots of notes. As clever as machine learning is, it’s only as good as your inputs.

Writing with GPT-X is not simply about churning out text – this text does needs to be worked on (This is not ‘cheating’ – Burroughs used to screen his manual cut-ups, looking for poignant and interesting generated sections). There are also different ways to work with the system – Robin Sloan has described some of the techniques he has used, such as hiding prompts from the reader (but not the model) to produce effective writing. These techniques are all waiting to be explored.

Matt Webb has written in detail about his experience of this collaboration in GPT-3 is an idea machine:

Using GPT-3 is work, it’s not a one-shot automation like spellcheck or autocomplete. It’s an interactive, investigative process, and it’s down to the human user to interview GPT-3. There will be people who become expert at dowsing the A.I., just as there are people who are great at searching using Google or finding information in research libraries. I think the skill involved will be similar to being a good improv partner, that’s what it reminds me of.

GPT-3 is capable of novel ideas but it takes a human to identify the good ones. It’s not a replacement for creative imagination. In a 15 minute session with the A.I., I can usually generate one or two concepts, suitable for being worked up into a short story, or turned into a design brief for a product feature, or providing new perspectives in some analysis – it feels very much like a brainstorming workshop, or talking something through with a colleague or an editor.

GPT-X can produce text faster than anyone can read it, but as Sloan writes, “it’s clear that the best thing on the page, the thing that makes it glow, is the part supplied by a person“.

For me, the question is whether it can produce interesting art (particularly art that is not solely interesting because of its process). What I’ve seen so far is both spooky and exciting. Whether this is more than a cheap trick of text remains to be seen, but my initial explorations make me very excited about collaborating further with this model.