#OTalk Transcript
Healthcare social media transcript of the #OTalk hashtag.
– ().
See #OTalk Influencers/Analytics.
| Profile | Tweet |
|---|---|
 | #OTalk @OTalk_ Welcome to #Otalk Research. Whether you have experience of using pilot studies, in the process of designing a pilot study or would like to learn more to help you evaluate studies, hopefully you'll find tonight's chat useful. |
| #OTalk @OTalk_ Say "hello" if you are joining us this evening and don't forget the #Otalk |
 | Dr Jenny Preston MBE @preston_jenny Hi everyone, really looking forward to tonight's #Otalk though slightly nervous being on this side of the account with @NikkiDanielsOT |
 | Dr Lynne Goodacre 💙 @LynneGoodacre Hi everyone - great to be back in 2019 with #otalk research |
 | Alex Smith @YmchwilStroc @OTalk_ Noswaith Dda pawb, evening all #OTalk |
| Dr Jenny Preston MBE @preston_jenny Let’s get started with the first question. Question 1 What does the term ‘pilot study’ mean to you and what do you think are the main reasons for conducting a pilot study? #OTalk @NikkiDanielsOT |
| #OTalk @OTalk_ Icebreaker question this evening. What does the term 'pilot study' mean to you? #Otalk |
| #OTalk @OTalk_ @emmaspellmanOT Hi Emma! Lots of learning tonight hopefully #Otalk |
| #OTalk @OTalk_ @OTizzie Or is it? I'm sure all will become clearer during the #Otalk chat @preston_jenny |
| #OTalk @OTalk_ Here's the first question tonight from @preston_jenny #Otalk |
| #OTalk @OTalk_ Anyone got any thoughts on @OTizzie question? #OTalk |
| Dr Jenny Preston MBE @preston_jenny Good point @OTzzie, even the MRC Framework for evaluation complex interventions uses the terms interchangeably #OTalk |
| #OTalk @OTalk_ RT @preston_jenny: Good point @OTzzie, even the MRC Framework for evaluation complex interventions uses the terms interchangeably #OTalk |
| Dr Jenny Preston MBE @preston_jenny Might there be specific aspects of the research/trial that you might wish to test @mirnoonanOT #OTalk |
| Alex Smith @YmchwilStroc @preston_jenny @NikkiDanielsOT When I hear ‘pilot study’, I think of a small scale preliminary study to ascertain whether crucial components of an intervention or study design are feasible etc. for a further large scale study. So an essential building block for research #OTalk |
| #OTalk @OTalk_ Perhaps we might have some examples from researchers who have carried these out? Help us with some context to understand the difference or if indeed there is a difference? #Otalk |
| Dr Jenny Preston MBE @preston_jenny RT @YmchwilStroc: @preston_jenny @NikkiDanielsOT When I hear ‘pilot study’, I think of a small scale preliminary study to ascertain whether crucial components of an intervention or study design are feasible etc. for a further large scale study. So an essential building block for research #OTalk |
| #OTalk @OTalk_ Any thoughts? #Otalk |
| Dr Lynne Goodacre 💙 @LynneGoodacre This is how I think of it as well @EllenChisman the clue is in the word 'feasible' #otalk |
| #OTalk @OTalk_ RT @LynneGoodacre: This is how I think of it as well @EllenChisman the clue is in the word 'feasible' #otalk |
| Dr Jenny Preston MBE @preston_jenny Moving on to the next question.Can you tell us about your experiences of conducting, observing or taking part in a pilot study? #OTalk @NikkiDanielsOT |
| #OTalk @OTalk_ RT @mirnoonanOT: |
| Dr Jenny Preston MBE @preston_jenny RT @mirnoonanOT: |
| #OTalk @OTalk_ Lots of great reasons for carrying out pilots and lots of questions raised already that hopefully we can explore further this evening #OTalk |
 | Sam Pywell @smileyfacehalo @Bsidebaby_ @OTalk_ #OTalk lurking too.... Good evening everyone!.... |
| #OTalk @OTalk_ Question 2 #OTalk |
| Dr Lynne Goodacre 💙 @LynneGoodacre I think this is where the confusion lies - because of the word feasible - so if I pilot a questionnaire I want to know some very specific things about it which are broader than the word feasible #OTalk |
| Dr Lynne Goodacre 💙 @LynneGoodacre So as part of pre -validating a questionnaire the pilot study might explore things like do people understand the questions, is anything missing, is it too short/too long, are the choices for answering the questions right etc #OTalk |
| Dr Jenny Preston MBE @preston_jenny RT @LynneGoodacre: So as part of pre -validating a questionnaire the pilot study might explore things like do people understand the questions, is anything missing, is it too short/too long, are the choices for answering the questions right etc #OTalk |
| #OTalk @OTalk_ RT @OTizzie: |
 | Bill Wong, OTD, OTR/L @BillWongOT Hello folks! joining late because of a phone call #otalk |
| Bill Wong, OTD, OTR/L @BillWongOT @preston_jenny @NikkiDanielsOT It means to me that it is a study that is considered as a test of concept- evidence might be scarce. #otalk |
| #OTalk @OTalk_ Anyone any experience of doing this? #Otalk |
| Dr Jenny Preston MBE @preston_jenny You sound like you have some experience of this @emmaspellmanOT, is there any good advice that you can share with others #OTalk @NikkiDanielsOT |
| Bill Wong, OTD, OTR/L @BillWongOT RT @hooper_ek: |
| Dr Jenny Preston MBE @preston_jenny What did the feasibility study tell you @hooper_ek and how did that inform your actual study #OTalk @NikkiDanielsOT |
| Dr Jenny Preston MBE @preston_jenny RT @emmaspellmanOT: |
| #OTalk @OTalk_ RT @preston_jenny: You sound like you have some experience of this @emmaspellmanOT, is there any good advice that you can share with others #OTalk @NikkiDanielsOT |
| Dr Jenny Preston MBE @preston_jenny Do you have any learning to share with us @Suze17 #OTalk @NikkiDanielsOT |
| Alex Smith @YmchwilStroc @LynneGoodacre Definitely, feasibility is a catch all term for the evaluation of pilot studies. Others have mentioned other important concepts which sit under this feasibility umbrella e.g adherence, acceptability. I think we can be clear that pilot studies don’t evaluate effectiveness #OTalk |
| Dr Jenny Preston MBE @preston_jenny @emmaspellmanOT Brilliant @emmaspellmanOT we are all learning and all experiences are equally valid #Otalk @NikkiDanielsOT |
| Dr Jenny Preston MBE @preston_jenny RT @YmchwilStroc: @LynneGoodacre Definitely, feasibility is a catch all term for the evaluation of pilot studies. Others have mentioned other important concepts which sit under this feasibility umbrella e.g adherence, acceptability. I think we can be clear that pilot studies don’t evaluate effectiveness #OTalk |
| Bill Wong, OTD, OTR/L @BillWongOT @NikkiDanielsOT test of concept means- the concept has not been proven, as it is still in exploratory stages. #otalk |
| Dr Lynne Goodacre 💙 @LynneGoodacre Here's a link to an NIHR document that explains the diff between feasibility and pilot studies for anyone interested https://t.co/BEN1z4nvox #otalk |
| Dr Jenny Preston MBE @preston_jenny RT @LynneGoodacre: Here's a link to an NIHR document that explains the diff between feasibility and pilot studies for anyone interested https://t.co/BEN1z4nvox #otalk |
| Dr Jenny Preston MBE @preston_jenny Great discussion tonight and we’ve already started to consider this but what are the main benefits observed from pilot studies? #OTalk @NikkiDanielsOT |
| Dr Jenny Preston MBE @preston_jenny RT @hooper_ek: |
| #OTalk @OTalk_ Any thoughts? #OTalk |
| Alex Smith @YmchwilStroc @NikkiDanielsOT @LynneGoodacre Do you think questionnaire ‘piloting’ in this sense sits neatly in the pilot study mould? In essence construct and content validity are about questionnaire effectiveness #OTalk |
| #OTalk @OTalk_ Thanks for sharing @LynneGoodacre Download and add to your reading list #Otalk |
| Dr Lynne Goodacre 💙 @LynneGoodacre Hmm interesting point @hooper_ek when I piloted a questionnaire we made some changes as a result of the pilot and tried it out with a few people but not as many as the original pilot #OTalk I guess the question is at what point do you stop piloting |
| Dr Jenny Preston MBE @preston_jenny Good question @YmchwilStroc and does that introduce a potential difference in the use of 'piloting' between quantitative and qualitative methodologies (somewhat provocative here, sorry) #OTalk @NikkiDanielsOT |
| Dr Jenny Preston MBE @preston_jenny Well that answers that question @willchegwidden, great succint summary #OTalk @NikkiDanielsOT |
| Dr Lynne Goodacre 💙 @LynneGoodacre I agree @YmchwilStroc I see construct and content validity as something which is tested in the main study #OTalk |
| Dr Jenny Preston MBE @preston_jenny Good example @mirnoonanOT thank you for sharing #OTalk @NikkiDanielsOT |
| Bill Wong, OTD, OTR/L @BillWongOT RT @willchegwidden: |
| Dr Jenny Preston MBE @preston_jenny Excellent examples @Suze17, this is exactly what the pilot study is intended to do #OTalk @NikkiDanielsOT |
| Dr Jenny Preston MBE @preston_jenny RT @LynneGoodacre: I agree @YmchwilStroc I see construct and content validity as something which is tested in the main study #OTalk |
| Dr Jenny Preston MBE @preston_jenny RT @hooper_ek: |
| #OTalk @OTalk_ RT @preston_jenny: Excellent examples @Suze17, this is exactly what the pilot study is intended to do #OTalk @NikkiDanielsOT |
| #OTalk @OTalk_ @Incredhead @LynneGoodacre @BJOTeditor Happens to the best of us 😀 #Otalk |
| Bill Wong, OTD, OTR/L @BillWongOT RT @OTizzie: |
| Dr Jenny Preston MBE @preston_jenny It is hard to keep up @emmaspellmanOT, I'm stuggling a bit tonight too but the discussion is great with some fantastic examples of learning and sharing #OTalk @NikkiDanielsOT |
| #OTalk @OTalk_ Lots of great discussions going on tonight @emmaspellmanOT so it is hard to keep up! The transcript will help if we've all been good and used the #Otalk 😀 |
| #OTalk @OTalk_ RT @preston_jenny: It is hard to keep up @emmaspellmanOT, I'm stuggling a bit tonight too but the discussion is great with some fantastic examples of learning and sharing #OTalk @NikkiDanielsOT |
| Dr Jenny Preston MBE @preston_jenny Where is the time going tonight? Are we ready for Question 4 What, if any, are the challenges in relation to pilot studies? #OTalk @NikkiDanielsOT |
| #OTalk @OTalk_ RT @preston_jenny: Well that answers that question @willchegwidden, great succint summary #OTalk @NikkiDanielsOT |
| #OTalk @OTalk_ It's been a great discussion and its going fast! Any challenges to share? #Otalk |
| Bill Wong, OTD, OTR/L @BillWongOT lurking for the remainder of the check... see you guys next week. #otalk |
| Dr Lynne Goodacre 💙 @LynneGoodacre When you're recruiting from a small pool of potential participants not using them all up in the pilot #OTalk |
| Dr Jenny Preston MBE @preston_jenny Thanks @ozcboss #OTalk discusses research on the first Tuesday of the month. Do join us or perhaps you might even consider hosting a chat. |
| #OTalk @OTalk_ @ozcboss Thanks for sharing. First Tuesday of every month our chat focuses on a research topic so feel free to join us #Otalk |
| Dr Jenny Preston MBE @preston_jenny Very good point @LynneGoodacre #OTalk @NikkiDanielsOT |
| Dr Jenny Preston MBE @preston_jenny Another excellent example, thanks for sharing @hooper_ek #OTalk @NikkiDanielsOT |
| Dr Jenny Preston MBE @preston_jenny Were you successful with the funding bid @Incredhead and were you able to conduct the study? #OTalk @NikkiDanielsOT |
| Dr Lynne Goodacre 💙 @LynneGoodacre Design in a great point for sure - needing to be clear about exactly what you are wanting to find out through the pilot and ensuring its design will explore those issues #OTalk |
| Dr Jenny Preston MBE @preston_jenny RT @emmaspellmanOT: @preston_jenny @OTalk_ @NikkiDanielsOT Q3: |
| Dr Jenny Preston MBE @preston_jenny I feel like I’m rushing now but now for our final question of the night. How do you know if you have done enough piloting to execute a larger scale study? #OTalk @NikkiDanielsOT |
| Alex Smith @YmchwilStroc @NikkiDanielsOT @LynneGoodacre I’ve not seen the term pilot or feasibility applied in ‘questionnaire’ or PROMs research as you would need a pre-defined sample size etc. to determine construct or content validity. Too small a sample and the stats won’t work. So not really piloting #OTalk |
 | Faith Martin @fam6 RT @LynneGoodacre: Here's a link to an NIHR document that explains the diff between feasibility and pilot studies for anyone interested https://t.co/BEN1z4nvox #otalk |
| Dr Lynne Goodacre 💙 @LynneGoodacre we reported this in the paper for the main study rather than as a paper in it's own right #OTalk |
| #OTalk @OTalk_ Last question of the evening! #Otalk |
| Dr Jenny Preston MBE @preston_jenny RT @LynneGoodacre: we reported this in the paper for the main study rather than as a paper in it's own right #OTalk |
| #OTalk @OTalk_ @caralawrence Its been a very informative chat. Lots of questions answered and raised #Otalk |
| Dr Jenny Preston MBE @preston_jenny Its been a great chat tonight @caralawrence some excellent real life examples being shared. I can't wait to read the transcript #OTalk @NikkiDanielsOT |
| Dr Jenny Preston MBE @preston_jenny I think that is a very real risk @hooper_ek and such a pity #OTalk @NikkiDanielsOT |
| #OTalk @OTalk_ RT @preston_jenny: I think that is a very real risk @hooper_ek and such a pity #OTalk @NikkiDanielsOT |
| Dr Lynne Goodacre 💙 @LynneGoodacre before you even get to using the questionnaire in the main study @YmchwilStroc questionnaires are usually piloted, once the items have been generated, with a small number of people to check that the questions can be understood etc etc #OTalk |
| Alex Smith @YmchwilStroc @preston_jenny @NikkiDanielsOT When you succesfully obtain funding to run the large scale trial? 😆 #OTalk |
| #OTalk @OTalk_ 5 minute warning. Keep the comments coming. So much learning tonight #OTalk |
| Dr Jenny Preston MBE @preston_jenny As a PhD supervisor we always get the blame!! What factors do you think might be taken into consideration? #OTalk @NikkiDanielsOT |
| #OTalk @OTalk_ #OTalk – 12th February 2019 – TBI and Cognitive rehabilitation: https://t.co/j30ROg7laZ |
| #OTalk @OTalk_ The pilot study can be a very important part of the research process so thanks you to everyone for your contributions; it is great to have learnt so much this evening and have some reading to do to learn some more #OTalk |
| Alex Smith @YmchwilStroc @LynneGoodacre Definately! I find these tend to be more qualitive, focus group type explorations as opposed to statistical analyses of construct validity etc. Would be interested if you have contrary examples #OTalk |
| Dr Jenny Preston MBE @preston_jenny Can't argue with that @YmchwilStroc. Sounds like you have been successful with your finding bid. Congratulations #OTalk @NikkiDanielsOT |
| Dr Lynne Goodacre 💙 @LynneGoodacre thanks also to @NikkiDanielsOT and @preston_jenny for making us think at this time of night! #otalk |
| #OTalk @OTalk_ That's it folks! Please do keep chatting. Thank you very much to @preston_jenny for leading with tonight's questions. Goodbye from @NikkiDanielsOT on the #Otalk account |
| Dr Jenny Preston MBE @preston_jenny It's a brilliant job! I learn so much from my PhD students and I'm always so proud of their achievements #OTalk @NikkiDanielsOT |
| #OTalk @OTalk_ @EllenChisman Thank you for joining us #Otalk |
| Dr Lynne Goodacre 💙 @LynneGoodacre can't think of any contrary examples at the moment @YmchwilStroc certainly qual but when I've done this it's been more 1:1 than focus groups #Otalk |
#OTalk content from Twitter.