BBC Lab UK

BBC Lab UK was a BBC website that allowed the public to take part in online experiments by completing tests and surveys.[1] The website was active for four years until its data collection ceased in May 2013. Details of the experiments and projects have now been archived.[2]

Lab UK was commissioned in 2008, inspired by other online ‘citizen science’ projects such as Galaxy Zoo and BugGuide. The intention was to enable leading academics to harness the BBC’s audience, using mass public participation to explore scientific hypotheses with very large data sets. The results would be published in academic journals and made available to the public through the BBC website and television. [3]

Lab UK was conceived by BBC executive producer Richard Cable, who also edited it from 2008-2011. A number of professional scientists were engaged to consult on the design and development of the website, as well as the design of individual experiments which the public would engage with.

Each web experiment was structured to give feedback on the activity of the participant, immediately after they had submitted their data. Collectively, the experiment data would be handed over securely to the scientist who had designed the experiment. The analysis of the experiment data would be conducted by the scientist’s research team. Where possible, the BBC actively encouraged the publication of the results in peer-reviewed journals.[4]

The first experiment was published in 2009 and the final experiment was launched in 2012. The website stopped collecting data in May 2013 after its migration to the Knowledge & Learning product. The website was formally archived in March 2016.

History

The BBC’s iF&L department had published several online quizzes to accompany BBC science television programming. Scientists such as Dr Val Curtis and Dr Stian Reimers asked whether they might analyse the anonymous data generated by the completion of these online quizzes. In ‘The Disgust Test’[5] and ‘Sex ID’,[6] specific hypotheses were tested in the online experiments. The results were published in specialist journals. BBC's Multiplatform commissioners decided to make a re-usable experiment publication platform that could save all data to a common database.

Experiments

The Big Stress Test

The Big Stress Test was Lab UK’s beta launch candidate in May 2009. The experiment was designed by Professor Peter Kinderman from the University of Liverpool and Dr Sara Tai from the University of Manchester. The experiment was promoted via the BBC’s mental health and wellbeing website ‘Headroom’. This experiment received roughly 6,000 participants. The experiment was updated and re-launched in 2011.

Brain Test Britain

A collaboration with the Medical Research Council, Cambridge University, King's College London, the Alzheimer's Society and the BBC One Television programme, Bang Goes The Theory - this longitudinal experiment, launched in September 2009, sought to discover whether brain training games made any improvement to IQ for a healthy, general population.[7] The Lab UK website hosted a series of brain training games and the study was structured as a clinical randomised controlled trial. The study contained over 60,000 people for 6 weeks. The study designers, Dr Adrian Owen and Professor Clive Ballard analysed the data and concluded the games made no difference to a healthy adult population.[8] The results were published in Nature and televised on a BBC One special.

The Big Personality Test

Launched on BBC One’s One Show in November 2009, this cross-sectional survey was developed in partnership with University of Cambridge. It used the Big Five personality measure and a range of other well-used psychometric and health measures to determine the correlations between personality and life outcomes. The results informed the returning series ‘Child of Our Time’.[9] The online website featured interactive video presented by Professor Robert Winston which presented your personal results of the personality test. The experiment received over 100,000 participants in the first two days and has received more than 750,000 participants in total.[10]

The Web Behaviour Test

This experiment was launched in conjunction with the BBC Two programme ‘The Virtual Revolution’ in February 2010.

How Musical Are You?

Developed by researchers at Goldsmiths College, University of London, this experiment explored the relationship between potentially untapped musical ability and musical sophistication. The test was promoted in conjunction with BBC Radio 3’s ‘Genius of Mozart' season in January 2011.

The Great British Class Survey

This was the first social science experiment to be co-commissioned by the BBC’s Current Affairs department.[11] Professor Mike Savage and Professor Fiona Devine designed a survey to measure different sociological capitals. The stated ambition was to create a new snapshot of British society and develop some newer, more relevant class labels for the 21st century. The BBC later commissioned a face-to-face recruited survey of roughly 1000 people to overcome the intrinsic class bias of the BBC audience.[12] The survey was promoted on BBC One’s One Show by Professor Mike Savage in January 2011. (also see 'The Great British Class Survey')

The Big Money Test

Collaborating with BBC One’s consumer programme Watchdog, this experiment aimed to discover the psychological traits that led to money problems in a large general population. The test was designed by researchers from the Open University and University College London. It was launched in April 2011 by Watchdog’s finance presenter, Martin Lewis, who featured in the interactive video feedback.[13]

The Big Risk Test

This experiment was developed by Professor David Spiegelhalter and Dr Mike Aitken of Cambridge University. It tested a hypothesis of linkage between numeracy and judgement of risk. The experiment contained various verified measures and a selection of interactive puzzles which tested various aspects of risk judgement. The experiment was promoted on the BBC One science TV programme, “Bang Goes the Theory” in April 2011.[14]

The BBC Stress Test

This updated version of the earlier experiment presented more comprehensive feedback and was re-launched by Claudia Hammond on BBC Radio 4’s ‘All in the Mind’ in June 2011.[15]

The Get Yourself Hired Test

This experiment into job seekers’ psychological skills accompanied BBC Three’s ‘Up For Hire’ programme. It was promoted in October 2011.[16]

Test Your Morality

This experiment was developed by researchers at the London School of Hygiene and Tropical Medicine. Building on from ‘The Disgust Test’, this test aimed to test a Human Superorganism hypothesis, and an evolutionary theory of human morals. The survey contained detailed demographic information and 33 ‘vignettes’ which attempted to test people’s responses to immoral behaviour across different moral domains. The test was promoted in November 2011.[17]

Can You Compete Under Pressure?

This experiment was developed by researchers from Sheffield and Wolverhampton Universities. The experiment aimed to test how effective 4 different sports psychology techniques were compared to a control in improving performance at a simple number grid task.[18] The test provided randomised psychological interventions to participants via video clips from Olympic sprinter, Michael Johnson. Participants played the 'Grid' game four times and their performance improvement (or not) was measured. Part of the interactive video feedback by Johnson was the first item to be filmed at Lund Point, the decommissioned block of flats in Stratford that was to become BBC TV’s Olympic HQ. The experiment was launched by Michael Johnson on BBC One’s The One show in May 2012.[19]

Results

The Stress Test

The original data was combined with the data from the re-launched experiment. The findings were significant and were publicised both in peer-reviewed journals and on BBC News and Radio platforms. An All in the Mind special edition detailed some of the ‘thinking styles’ which can lead to depression. More than 30,000 cases of data were analysed to find these results.[20]

Brain Test Britain

The data from the longitudinal study was analysed and the results were featured in Nature - ‘Putting brain training to the test’. The results were publicised on BBC One’s Bang Goes the Theory Television programme. The results have caused some controversy, as some researchers said the study ignored the training effects on older, less healthy subjects and that the study instruments weren’t sufficiently similar to commercially available products.[21][22]

The Big Personality Test

Preliminary results were extracted from the initial data, which contained more than 100,000 cases. These were used to inform the subject matter of the BBC One TV programme, ‘Child of Our Time’ which aired in May 2010. Over 500,000 cases were recorded in the database by May 2013.[23] The first peer-reviewed paper published based on these data, concerned the psychological aspects of childhood sexual abuse survivors.[24] A study has been published examining the geographical associations between personality and life satisfaction using over 50,000 cases from residents of London. [25] A further study, mapping the regional differences in personality in Great Britain was published in PLoS One.[26] These two studies were the basis for the BBC iWonder's interactive guide "Where in Britain would you be happiest?"[27]

The Web Behaviour Test

Over 50,000 people completed the survey. The results were written up in the Journal of Information Management in 2011. The authors believed they detected differences between 'generations' in their information seeking strategies with younger people apparently possessing "poorer working memories and are less competent at multi‐tasking" [28]

The Big Money Test

Over 100,000 people completed the survey. The results were written up in a report in March 2012. The test found clear linkage between impulse buying behaviour and serious financial problems.[29]

How Musical Are You?

Over 150,00 people completed the test. The researchers’ findings were published in PLoS One in February 2014.[30]

The Great British Class Survey

Over 150,000 cases of data plus the recruited GfK survey led to a paper in Sociology.[31] This was synchronised with the publication in March 2013 in the BBC News website of the Great British Class Calculator. The calculator is a web application that asks seven questions from the original survey, and categorises each person into the newly found class categories, depending on their results.[32] The calculator was extremely popular with it being used over 6.5 million times in a week.[33] However it was misunderstood in some quarters with some people thinking it generated the results itself, rather than analysis of the original survey data. The Class Calculator spawned spoofs in popular media but also serious criticism in social science circles.[34] The paper published by Sage Journals is the most downloaded Sociology journal paper of all time with over 23,000 downloads.[35] The paper revealed a new class system for Britain with seven classes which described the changing stratification of modern Britain and the reduction of size of traditional class segments like the working class and the traditional middle class.

Can You Compete Under Pressure?

Over 110,000 people took part, with a sample of 44,000 analysed. The results were written up in the Frontiers of Psychology journal and found that brief online psychological training could be effect in improving performance, especially the use of the 'self-talk' technique. Other findings noted the importance of emotional control, and the general improvement of the control group throughout the trials demonstrating the value of practice and Michael Johnson's control interventions.[36]

Technical challenges

The BBC Lab UK platform was built using the BBC’s new Forge application server, and was interconnected with other BBC online services such as BBC ID, BBC EMP, MemCache amongst others. BBC ID was employed as a sign-ed service was needed to help keep participant’s data secure, and to prevent malicious submissions. The BBC Lab UK platform was re-built three times. First in 2010 to improve scalability.[37] Second, in 2011 to reduce loadtimes and server load. A third time in 2012 to re-factor after substantial changes in the BBC online infrastructure.

De-commission

After BBC Multiplatform’s dissolution in 2011, BBC Lab UK was one of a number of web products migrated to the new Knowledge & Learning product. Senior management decided in 2013 that all technical effort would now be spent building this product rather than supporting the Lab UK service. From 1 May 2013, the website stopped collecting experiment data, although most of the experiments still offer feedback to those who have already completed the tests. The website was permanently 'mothballed' on the 18th of March 2016.

Data deposition

The data from the Great British Class Survey has been deposited in the UK Data Archive (University of Essex) for use by other academic researchers. Data from 'The Big Personality Test' and 'The Big Money Test' have also been deposited.

References

  1. ↑ http://www.bbc.co.uk/labuk/articles/
  2. ↑ http://www.bbc.co.uk/labuk/
  3. ↑ http://downloads.bbc.co.uk/aboutthebbc/insidethebbc/howwework/reports/pdf/digital_britain_exec.pdf
  4. ↑ http://www.bbc.co.uk/labuk/articles/
  5. ↑ http://www.bbc.co.uk/science/humanbody/mind/articles/emotions/disgust.shtml
  6. ↑ http://www.bbc.co.uk/science/humanbody/sex/articles/more_info.shtml
  7. ↑ https://ssl.bbc.co.uk/labuk/results/braintestbritain/1_results_summary.html
  8. ↑ http://www.nature.com/nature/journal/v465/n7299/full/nature09042.html
  9. ↑ http://www3.open.ac.uk/media/fullstory.aspx?id=18876
  10. ↑ http://www.bbc.co.uk/blogs/internet/posts/BBC-Lab-UK-The-Great-British-Class-Calculator-and-beyond
  11. ↑ http://www.broadcastnow.co.uk/news/multiplatform/bbc-to-kick-off-online-survey-on-uk-class-system/5022901.article
  12. ↑ http://www.bbc.co.uk/science/0/22006066
  13. ↑ http://www.bbc.co.uk/blogs/tv/posts/watchdogs-money-test
  14. ↑ http://www.cam.ac.uk/research/news/science-is-a-risky-quiz-ness-a-new-study-aims-to-assess-how-we-perceive-risks
  15. ↑ http://www.bbc.co.uk/blogs/radio4/posts/all_in_the_mind_take_the_bbc_s
  16. ↑ http://www.bbc.co.uk/mediacentre/latestnews/141011hire
  17. ↑ https://www.bbc.co.uk/news/magazine-15619543
  18. ↑ http://www.esrc.ac.uk/news-and-events/features-casestudies/features/20716/carousel-performing-under-pressure.aspx
  19. ↑ http://www.wlv.ac.uk/default.aspx?page=40076
  20. ↑ http://www.bbc.co.uk/science/0/24451567
  21. ↑ https://www.theguardian.com/science/2013/apr/21/brain-training-online-neuroscience-elizabeth-day
  22. ↑ https://books.google.com/books?id=C1BbBAAAQBAJ&pg=PT56&lpg=PT56&dq=brain+test+britain+bbc&source=bl&ots=RfSWPPosPw&sig=88gEKFNCvqWZxx0EteK4JjbAyS8&hl=en&sa=X&ei=gY4-VLDKFIre7Ab1s4DoDQ&ved=0CDoQ6AEwBDge#v=onepage&q=brain%20test%20britain%20bbc&f=false
  23. ↑ http://www.psychol.cam.ac.uk/adprg/research-group-news
  24. ↑ http://cpx.sagepub.com/content/1/4/351.short
  25. ↑ http://www.pnas.org/content/112/3/725
  26. ↑ http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0122245
  27. ↑ http://www.bbc.co.uk/guides/z3g487h
  28. ↑ http://www.emeraldinsight.com/doi/abs/10.1108/00012531111103768
  29. ↑ http://www.friendsprovidentfoundation.org/wp-content/uploads/2013/10/Open-University-Analysing-the-Big-Money-Test-Summary.pdf
  30. ↑ http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0089642
  31. ↑ http://soc.sagepub.com/content/47/2/219
  32. ↑ https://www.bbc.co.uk/news/magazine-22000973
  33. ↑ http://www.bbc.co.uk/blogs/legacy/theeditors/2013/04/the_great_british_class_calcul.html
  34. ↑ http://stratificationandculture.wordpress.com/2013/09/15/a-statement-on-future-research-from-the-great-british-class-survey/
  35. ↑ http://www.methodologicalinnovations.org.uk/wp-content/uploads/2013/11/2.-Geoff-Payne.pdf
  36. ↑ Lane, A. M.; Totterdell, P; MacDonald, I; Devonport, T. J.; Friesen, A. P.; Beedie, C. J.; Stanley, D; Nevill, A (2016). "Brief Online Training Enhances Competitive Performance: Findings of the BBC Lab UK Psychological Skills Intervention Study". Frontiers in Psychology. 7: 413. doi:10.3389/fpsyg.2016.00413. PMC 4811866. PMID 27065904.
  37. ↑ http://matt.chadburn.co.uk/presentations/tech-review-20100701.pdf
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.