Developing and Maintaining Textal

tl;dr – Textal has not been working for a while but we’ve fixed it and released a new up-to-date version today! New features coming in the next update.

I won’t lie, development on Textal has been slow. In only 385 days after the initial launch of Textal we have more than 2,263 active users in the last 6 months, over 4,000 installs and over 78 million words processed by the single server we use to do all the hard work of turning your words into beautiful interactive clouds. To be honest, neither Melissa or I ever thought that Textal would take off quite like it has in reality. We built a system that we would use ourselves and seeing other people around the world, in over 38 different countries, justifies all the hours we both put in to build the system. Fast Forward a year and a lot has changed.

We launched 2 months before iOS 7 was released and we didn’t have time before launch to change all the codebase to support the new user interface guidelines. Twitter changed their API’s effecting how we collect twitter using your phone. To top it all off Project Gutenberg even changed their API’s which meant that fetching books became impossible without resorting to a few tricks to keep Textal from completely breaking. If you have used Textal recently you probably noticed some problems but never realised what was happening behind the scenes. A recent comment in the iTunes Store made me sit up and take notice.

Great but…
Love the concept but the app seems to be broken now? I can’t import books nor tweets. Will update the rating when it works the way it’s supposed.

Another feedback: it’d be interesting to see the frequency of 2-grams instead of merely ranking them. And maybe throw in 3-grams as well? 🙂

— BAM875

Thanks BAM875 for your feedback, it’s great to get new ideas to add features to the app but even better when our users do the testing for us!

First of all let me assure you that Textal isn’t dead! I’m the only developer that works on Textal – just me! I created the app, I created the server, I keep the server from crashing and actually manage the physical machine that runs Textal along with 50 other academic systems that run on the virtual machine. At the same time I’m working as a researcher at UCL CASA, I’m writing a new course from scratch, I’m finishing off my PhD which I started around the same time as I started building Textal, I’m building the software to support my PhD, I’m doing systems admin for the department and somewhere admits all this I’m trying to have a social life outside work. I really have been so busy I’ve neglected a lot of my active development projects. This is the way of most academic projects.

We built Textal on a shoestring: £10,000, 3 people (a graphic designer, a project lead/marketing, and a single developer). When you look at a normal tech startup company, they can get up to 10 times that amount to bring a product to your phone. The disadvantage to this is if anything goes wrong – and believe me, any project you build over time things will start breaking – you don’t have any time to go back to an older project to fix it as you have to look forward and build the next system that will bring the funding in. Welcome to modern day Academia. No big teams developing new feature and making sure the product is working, no time just to check that the system is running. This is where users come in, just letting us know that something’s not right will make us stand up and do something about it.

Today we are releasing a new version of Textal. It’s been updated to look better on iOS 7, we have a new icon, all the bugs fixed and Textal is once again fully useable to create word clouds. I’ve also added some new features to the app which makes it easier to use. When you submit your word cloud, Textal will now tell you when all the stats have been created even if your not in your app. You no longer need to wait until Textal has finished processing. Go check an email or look up the news, if you have enabled notifications Textal will pop up an event and let you know when the stats are ready to view. You can turn this off in the settings if it becomes annoying or better yet just let us know on twitter.

In the coming months we have new features planned and we will release them once the features have been fully tested. We’re working to make the app easier to use and exploring our options on how to bring Textal to as many platforms as we can. Just be patient with us. We’re all really busy but we want to grow Textal in the next year so watch this space.

Thanks for helping us grow Textal and here’s to the next 385 days!

What can a text analysis smartphone app do for Digital Humanities?

Textal

In July this year we presented a Textal poster at the Digital Humanities 2013 conference hosted in the United States by the University of Nebraska-Lincoln. The other day we were asked by the Journal of Digital Humanities if we could release the poster under a Creative Commons Attribution licence.

Indeed, we can.

The poster copy as reproduced below is hereby released under the CC BY 2.0 UK licence, as is the A2-sized conference poster [PDF] you might want to download.

Launched for iOS on 9 July 2013 after two years in development, Textal is a free smartphone app that allows users to analyze documents, web pages and tweet streams, exploring the relationships between words in the text via an intuitive word cloud interface. The app generates visualizations and statistics that can be shared without effort, which makes it a fun and useful tool for both research and play, bridging the gap between text analysis and mobile computing.

Text analysis is a powerful technique that has been used since the very first computers were built, yet it is not very well known to the public today. We built Textal to promote text analysis as a way to unearth the themes and hidden uses of language within text. We provide pointers that allow users to learn more about the technique, as we think of Textal as a public engagement tool for Digital Humanities which will give people a flavour of text analysis, and which might encourage them to take a deeper interest in computational analysis.

We also built Textal to explore the opportunities available in mobile computing. To determine the potential audience for this type of service and to learn more about the kind of texts people want to analyze, we are conducting a reception study into Textal’s uptake and usage, which we expect to be of great interest to the wider Digital Humanities audience. We are now watching uptake and usage closely: When someone uses Textal, their activity generates data which we are gathering and which we will analyse as part of a research project in order to learn more about opportunities for Digital Humanities tools in the mobile space. We will use the data we gather solely for research, and we will protect our users’ privacy throughout our work.

Textal was built by a very small team and, at present, the app is available only on iOS. Building an Android version will depend on the success of the iOS version.

The Textal team are happy to receive feedback from the Digital Humanities audience: to ask questions about Textal, do get in touch at info@textal.org. For regular updates, follow @textal on Twitter, and for more detailed information visit Textal.org!

We can Haz Cupcakes! and the Textal Goodybag Giveaway

cupcakes

We’re having a shindig tonight at UCLDH to celebrate the success of Textal. A project isnt a success without a glass of wine, right? And some cupcakes!

We have ten goodybags to give away to our friends online who cant make it to the party. All you have to do to be in a chance to win is to share a wordcloud that you have made with textal on twitter, today. Winners will be chosen at random from those who join in. We’re not sure the cupcakes will last long enough to be put in the post, unfortunately…

Mapping Our Progress

Screen Shot 2013-09-21 at 14.39.20

Almost three months since we flicked the switch and went live – how are things going? We’ve now had more than 70 million words submitted by users, and have had submissions from 28 different countries, as you can see above. One of the things we are doing is looking at uptake and use, and our settings mean that (if those using Textal allow) we can see where it has been used. About 2/3rds of users let us see this information, which is helpful to show the reach and spread of the App.

Other things to report. We’ve had wordclouds created in 6 different languages. The content being put through the server broadly breaks down to 1/3 books, 1/3 websites, and 1/3 searches from twitter, with a slight bias towards twitter, but this indicates the different needs of users (personally, I had predicted that the twitter search would be much more popular than the books, for example – showing we need to understand user needs more).

We’ve being going through phases of leaving Textal to its own devices, and then activitely engaging with social media about it, promoting it with various hashtags, at events. etc. Unsuprisingly, it ticks over when we dont promote it, and there are spikes in downloads when we are being more active.

To celebrate a succesful launch, and the ongoing success of Textal, we’re having a drinks event at UCL Centre for Digital Humanities on the 2nd of October. There are a few places left but they are going fast- do sign up here and join us in having a few drinks to toast our adventures!

 

View from behind the wordcloud: how the launch went

Well. I’m not sure what we all at Textal Towers expected when we pressed “go public!” on the 9th July. Textal was built on an idea, a hunch, and a belief that it would be a useful addition to what is already out there for iOS… so what has happened?

Between the 9th and the 18th of July, Textal was downloaded to 429 different devices from iTunes.  17,042,109 individual words went through the Textal servers, making 419 word clouds created by 189 individual users. 6 different languages were used: most clouds were made in English, but there were also 14 in Spanish, 9 in French, and a handful in Dutch, Italian, and German. We made the top 100 apps in “Education” in two different countries – the UK, and Portugal (where we were in the top 40!).  About half of the people using Textal have allowed us to see their geolocation – so look forward to a map, next blog-post around.

I’m very pleased with this. Its really hard to measure “success” when it comes to this kind of thing, but I watch the counter go up by over a million words processed every day, and think – our hunch, our idea, our belief? worth doing.  At time of writing, more than 32,000,000 words have gone through Textal in the space of just a few weeks, and I’m watching the stats rack up of various clouds being looked at and shared. We very much wanted to show text analysis to a mass audience – and we have evidence to show that people are looking at, and using, the tools that we have provided. We’ve also found a few bugs, and a few usability issues that we need to address – all part of the learning curve – but that is to be expected. (If you do have any issues, please let us know, so we can fix them for you and for others).

What fun. And I think… how can we get the word out further? If you have downloaded Textal, if you are following us on twitter, please do help us to tell others.

Meanwhile, we are quietly smiling as we see people downloading, using, and talking about the app we spent so long tinkering with. Thanks!

3… 2… 1… Launch!

teal deer

We’re really pleased and proud as punch to say that Textal is now ready to download for free over at the app store.  What are you waiting for? Go over and play with it as soon as you can!

The launch is the culmination of two years of very hard work, and I would like to thank the team behind Textal, Steve, our developer extraordinaire, and Rudolf, our designer par excellence. Together we’ve burned the midnight oil, learning a lot about the intricacies of app development and design, whilst pulling together an innovative and useful introduction to text analysis for a mobile audience.

Over the next few months we’ll be exploring here how Textal was built, how the back end works, what you can do with it, and how it is being used.  Its been a great experience so far, and now we are buckling our seatbelts as we throw it open to you to play with. We’ll be keeping you up to date here, and on @textal on twitter.

And please meet Grendel, our teal deer. Too Long; Didn’t Read (TL;DR)? Use Textal to summarise and explore the text for you!

 

Update, and a sneak peek at Textal from NCRMUK

We’re into the final stages before we release the app for alpha testers. It looks now like we are going for a release on the app store at the start of September – fingers crossed. In the meantime, the lovely people from NCRMUK (who fund the grant that pays for Steve’s time) made a preview video of where we are with Textal. Enjoy!

 

Gearing up, yet chilling out

textal promo items

Things have been quiet around here (Steve and I both went on leave for a while) but we are now getting to the final stages of making the app. We hope to push a version out to users, for testing, in the next week or so. I’m now looking at lists of words which are used on … do you call them buttons when they are embedded into an app? … so we can think about translating the interface into other languages. And lookee here, a big batch of textal promotional items arrived, so we can start to crank up the promo machine.

But. The launch has to be put back. We would have had to get it into the app store round about now for that to happen – which we could have done, but we would have been really having to go some. Doable, but stressful. However, that wasn’t the limiting factor. We’ve been trying to set up an account on the App Store which would mean we could release this as UCLDH and UCLCASA – but we are mired in legal identities, UCL agreements, and who gets to assert the copyright on Textal, etc etc. We think we have found a way forward – and we are getting our ducks in a row to fight the good fight as far as copyright and IPR is concerned (it may be a free app, but we cant give away our copyright to someone else) – but it is funny how something like that can derail the time frame for the launch of a project.

So our room booking for the launch is cancelled. Not to worry, we’ll make a new one once Textal is up in the Apple Store, hopefully within the month.  We’ll keep you posted with progress, now we are back on the case.

Hi I’m Steve

I’m Steven Gray, a Research Associate at UCL Center for Advanced Spatial Analysis and also UCL Digital Humanities, Computing Scientist, Software developer and all round nice guy.  I’ve build lots of software for various platforms and devices in not only academia but out there in the scary world of commercial software development.

I remember when Melissa came to me and asked me if I’d like to come on board and create Textal.  I had just finished creating QRator, a platform and iPad application for Museum visitors to talk about objects.  QRator had been quite successful and I was looking for another exciting project to get my teeth sunk into.  I’d worked with Digital Humanties before with Claire Ross, a student of Melissa’s, and heard lots of stories (all good) about Mel but never met.   An email later and I found myself sitting in an office with Melissa.

My first thought – another Scot!, but not just any Scottish person, someone who not only had the same sense of humour as me but someone who had studied at the same university and department as me.  After a long conversation about Glasgow University and DCS we got down to talking about Textal. When I heard the idea, I was hooked!  I’d seen and used word clouds before but when she explained there never been an interactive word cloud before I was shocked.   It’s such a simple but important idea. If you make something interactive then people get a better understanding about what it all means and word clouds were such a fantastic visualisation.  This was a project which was not only fun to code, but actually could be used and understood by anyone.   I got quite excited but also quite scared at the same time.  How am I going to create this?  I’ve never made a word cloud before, nor have I done any Text Analysis.  This project was going to involve a steep learning curve.

A few months have passed and we now have a beta application.  I’m ironing out the bugs at the moment getting ready to launch the application in June.   My next few blog posts will take you through how I created the application, the thought processes and also the failures – trust me there were a few.

Creating Textal was really fun, and I really hope when you all get a chance to play with you’ll find it fun as well. Watch this space!

The Genesis of Textal

Hi! I’m Melissa Terras – Co-Director of UCL Centre for Digital Humanities, and Reader in Electronic Communication in the Department of Information Studies there. I’ve been involved with a variety of software development in the Humanities over the past decade, but I’ve never made an app before.

Textal was my idea. I remember the discussion in my head well, which is the type of trajectory that most of my research ideas come from. It was perhaps 3am or 4am and I was awake with my very young twins (again) and letting thoughts ramble. Why are there no apps yet in Digital Humanities? I thought. Wouldn’t it be great to have an app that showed off some Digital Humanities tools to a wider audience? I thought. Someone should make an app that demonstrates the kind of things that we do in Digital Humanities!  I thought. Which rapidly turned into… I should make an app that shows the kind on things that Digital Humanities do. Digital Humanities in your pocket! Oh dear, I thought. Now I’m going to do have to do it…

But why tackle word clouds? You’ll be familiar, no doubt, with text clouds – a basic visualization of word frequency in a given text as a weighted list – and probably wordles, the online text-cloud generation tool developed by a programmer at IBM in 2008. There’s no doubt that these can be kinda – sorta – useful visualisations of texts (there’s even been research into their usability). But those working in the field of Digital Humanities – the use of computational methods and approaches to undertake research and teaching in the Arts and Humanities – tend to sneer (rightly or wrongly) at wordles.

Text Analysis by computers has been a technique used in the Digital Humanities since the very earliest days of computing.   There are many pretty well understood techniques to look at things like authorship attribution, gender based bias in language, etc. Wordles are so basic in comparison. We know about word lists and stop words and frequency and concordances and… we can do Text Analysis! Why would you use Wordles? Now, there are some pretty good online tools to undertake Text Analysis in a serious fashion, such as Voyant (http://voyant-tools.org/). But there is a step change between wordles and these tools, with nothing in between.  There hasn’t been, to my knowledge, any linking up of word clouds with the underlying statistics of the text that we normally associate with Text Analysis. Wouldn’t it be cool if we could take a word cloud, and let people click on words of interest, and drill down into their text to see the actual statistics that underpin it? This action would also lend itself to the pinch and stretch paradigm on smartphones.  We can fix wordles, and make them robust, useful, interactive…

So the idea for Textal was born. The name, and the logo, came later. First I had to find the funding to undertake development (I had initially thought I would learn how to do it myself – its been a while since I’ve done some coding, and wouldn’t it be fun! But I quickly realized that that wasn’t feasible with my other duties and current hubbub at home).  I also had to find a research collaborator who would help me out. But those, my friends, are all stories for another blog post…