#OTalk Transcript

Healthcare social media transcript of the #OTalk hashtag.
().
See #OTalk Influencers/Analytics.

Sign up for FREE Symplur Account and Get
  • Create Transcripts with Custom Dates
  • Get Custom Influencer Lists
  • 3x Hashtag Search Results
Sign Up Now
ProfileTweet
OTalk @OTalk_
Welcome to #Otalk Research. Whether you have experience of using pilot studies, in the process of designing a pilot study or would like to learn more to help you evaluate studies, hopefully you'll find tonight's chat useful.
OTalk @OTalk_
Say "hello" if you are joining us this evening and don't forget the #Otalk
Angelyn Easton @AngelynJEaston
@OTalk_ Hello #Otalk, just lurking
Dr Jenny Preston MBE @preston_jenny
Hi everyone, really looking forward to tonight's #Otalk though slightly nervous being on this side of the account with @NikkiDanielsOT
Zahra Mansha @ZahraManshaOT
@OTalk_ Hello! 👋 #OTalk
Laura Occupational Therapist @Bsidebaby_
@OTalk_ lurking #OTalk
Emma Hooper @hooper_ek
@OTalk_ Evening all. Glad to be able to join the chat this evening #OTalk
Carolina Cordero 🌈 @colourful_ot
@OTalk_ Hello! #OTalk
Dr Lynne Goodacre @LynneGoodacre
Hi everyone - great to be back in 2019 with #otalk research
Ellen Chisman @EllenChisman
Good evening everyone. First OTalk in a while. Good to be back :-) #OTalk
Becky Cooper @beckycooper___
@OTalk_ Hello 👋🏻 #otalk most likely lurking tonight!
Izzie LR @OTizzie
@OTalk_ hello #OTalk 👋 Student OT here doing my dissertation on a feasibility study proposal (so not quite a pilot study but still interesting to join in!)
OTEmmaS @emmaspellmanOT
@OTalk_ Hello I'm here and looking forward to this chat and learning #OTalk https://t.co/3pcivKiLB8
Alex Smith @YmchwilStroc
@OTalk_ Noswaith Dda pawb, evening all #OTalk
OTalk @OTalk_
Icebreaker question this evening. What does the term 'pilot study' mean to you? #Otalk
Dr Jenny Preston MBE @preston_jenny
Let’s get started with the first question. Question 1 What does the term ‘pilot study’ mean to you and what do you think are the main reasons for conducting a pilot study? #OTalk @NikkiDanielsOT
OTalk @OTalk_
@emmaspellmanOT Hi Emma! Lots of learning tonight hopefully #Otalk
Suzanne Henshall @Suze17
@OTalk_ Hello 👋 #Otalk
OTalk @OTalk_
@OTizzie Or is it? I'm sure all will become clearer during the #Otalk chat @preston_jenny
Student Platform OT @SPOTeurope
@OTalk_ Hello!! #OTalk
OTalk @OTalk_
Here's the first question tonight from @preston_jenny #Otalk
Izzie LR @OTizzie
@OTalk_ Anyone confused between pilot/feasibility?! While writing my diss. I realised the terms are often misused. I think a pilot study implements all pieces of a study together to assess how well the components will work whereas a feasibility study tries out parts of a study #OTalk
Ellen Chisman @EllenChisman
Pilot study...I think of testing out. Maybe your questions for example. To a smaller initial sample. #OTalk
Angelyn Easton @AngelynJEaston
@OTalk_ Is it like a starting point to a wider area of research? #OTalk
OTalk @OTalk_
Anyone got any thoughts on @OTizzie question? #OTalk
OTEmmaS @emmaspellmanOT
Q1: I think small scaled down version of the real thing and a try-out of research proposal – at least maybe some elements of it #OTalk
carol duff @carolfish32
@OTalk_ Hi #otalk
Dr Jenny Preston MBE @preston_jenny
Good point @OTzzie, even the MRC Framework for evaluation complex interventions uses the terms interchangeably #OTalk
Miriam Noonan @mirnoonanOT
@preston_jenny @NikkiDanielsOT I’m thinking to test the feasibility &acceptability of your research/trial question if looking at conducting a trial? #OTalk
Suzanne Henshall @Suze17
@OTalk_ I’m thinking it’s about trying out your proposed method of research in practice in a mini way, to identify things you might need to tweak, alter or amend before you do the main one? #otalk
Emma Hooper @hooper_ek
Good point @OTizzie .... add field trials into the mix too & it can feel confusing! #otalk
OTalk @OTalk_
RT @preston_jenny: Good point @OTzzie, even the MRC Framework for evaluation complex interventions uses the terms interchangeably #OTalk ht…
Becky Cooper @beckycooper___
@preston_jenny @NikkiDanielsOT #otalk completing a small scale study prior to wider scale research to determine feasibility and to highlight any changes that need to be made?
Miriam Noonan @mirnoonanOT
@OTizzie @OTalk_ Ah I think I’m guilt of using these terms interchangeably! #OTalk
Izzie LR @OTizzie
@OTalk_ @preston_jenny I'd say they are different from the literature I've read defining them but both come under the term preliminary study. From talking to people, however, I do think researchers see them as the same...!! #OTalk
OTEmmaS @emmaspellmanOT
@OTalk_ @OTizzie is feasibility when you work out the potential pitfalls and strengths of a project and something that you might wasn't to use in the workplace more? #OTalk - off top of my head so apologies if wrong
Dr Jenny Preston MBE @preston_jenny
Might there be specific aspects of the research/trial that you might wish to test @mirnoonanOT #OTalk
Alex Smith @YmchwilStroc
@preston_jenny @NikkiDanielsOT When I hear ‘pilot study’, I think of a small scale preliminary study to ascertain whether crucial components of an intervention or study design are feasible etc. for a further large scale study. So an essential building block for research #OTalk
Ellen Chisman @EllenChisman
Is feasibility about practicality? Can you recruit enough, can you do it in time etc. Pilot study could include things like, do your questions allow you to gather the data you need to answer the research question. Will it do what you think it will do, a practice run? #otalk
OTalk @OTalk_
Perhaps we might have some examples from researchers who have carried these out? Help us with some context to understand the difference or if indeed there is a difference? #Otalk
Dr Jenny Preston MBE @preston_jenny
RT @YmchwilStroc: @preston_jenny @NikkiDanielsOT When I hear ‘pilot study’, I think of a small scale preliminary study to ascertain whether…
Dr Jenny Preston MBE @preston_jenny
RT @EllenChisman: Is feasibility about practicality? Can you recruit enough, can you do it in time etc. Pilot study could include things li…
OTalk @OTalk_
Any thoughts? #Otalk
Miriam Noonan @mirnoonanOT
@preston_jenny What first comes to mind is the outcome measures, how many and what outcomes to measure, is what I’m thinking of using acceptable to the population I’m conducting the research with? What is the recruitment process like - easy/difficult? #OTalk
Dr Lynne Goodacre @LynneGoodacre
This is how I think of it as well @EllenChisman the clue is in the word 'feasible' #otalk
OTalk @OTalk_
RT @LynneGoodacre: This is how I think of it as well @EllenChisman the clue is in the word 'feasible' #otalk https://t.co/juZezMePZU
Dr Jenny Preston MBE @preston_jenny
Moving on to the next question.Can you tell us about your experiences of conducting, observing or taking part in a pilot study? #OTalk @NikkiDanielsOT
OTalk @OTalk_
RT @mirnoonanOT: @preston_jenny What first comes to mind is the outcome measures, how many and what outcomes to measure, is what I’m thinki…
Dr Jenny Preston MBE @preston_jenny
RT @mirnoonanOT: @preston_jenny What first comes to mind is the outcome measures, how many and what outcomes to measure, is what I’m thinki…
OTalk @OTalk_
Lots of great reasons for carrying out pilots and lots of questions raised already that hopefully we can explore further this evening #OTalk
Samantha Pywell @smileyfacehalo
@Bsidebaby_ @OTalk_ #OTalk lurking too.... Good evening everyone!....
OTalk @OTalk_
Question 2 #OTalk
Dr Lynne Goodacre @LynneGoodacre
I think this is where the confusion lies - because of the word feasible - so if I pilot a questionnaire I want to know some very specific things about it which are broader than the word feasible #OTalk
Nikki Daniels @NikkiDanielsOT
RT @OTalk_: Lots of great reasons for carrying out pilots and lots of questions raised already that hopefully we can explore further this e…
Nikki Daniels @NikkiDanielsOT
RT @preston_jenny: Moving on to the next question.Can you tell us about your experiences of conducting, observing or taking part in a pilot…
Izzie LR @OTizzie
@EllenChisman I think that is one really big distinction yes! And there are different areas that can be addressed to identify practicality such as acceptability (of an intervention), demand, implementation and more #OTalk
Iris Benson MBE @irisbenson100
RT @carolfish32: @OTalk_ Hi #otalk
OTEmmaS @emmaspellmanOT
RT @LynneGoodacre: This is how I think of it as well @EllenChisman the clue is in the word 'feasible' #otalk https://t.co/juZezMePZU
Dr Lynne Goodacre @LynneGoodacre
So as part of pre -validating a questionnaire the pilot study might explore things like do people understand the questions, is anything missing, is it too short/too long, are the choices for answering the questions right etc #OTalk
Dr Jenny Preston MBE @preston_jenny
RT @LynneGoodacre: So as part of pre -validating a questionnaire the pilot study might explore things like do people understand the questio…
OTEmmaS @emmaspellmanOT
Useful for exploratory stage of research, findings from that guide researcher to more explanatory focus #OTalk
Nikki Daniels @NikkiDanielsOT
@LynneGoodacre Good point. I'm just about to pilot a questionnaire and as part of this will be assessing the construct and content validity. I'll get back to you once I've figure out how to do it! #OTalk
Ellen Chisman @EllenChisman
Q2: I had a pilot for my MSc research. Testing my interview schedule and skills. Been a subject in a pilot study at work for using a particular OT assessment #OTalk
Emma Hooper @hooper_ek
I was involved in a field trial where we were testing the feasibility, acceptability & tolerability of a complex intervention prior to RCT #OTalk @preston_jenny @OTalk
OTEmmaS @emmaspellmanOT
@OTalk_ Previous research required closed questions in a survey, in pilot I asked open ended questions in interviews & answers generated fixed choice answers which shaped closed questions for the main #OTalk
OTalk @OTalk_
RT @OTizzie: @EllenChisman I think that is one really big distinction yes! And there are different areas that can be addressed to identify…
Bill Wong, OTD, OTR/L @BillWongOT
Hello folks! joining late because of a phone call #otalk
Ellen Chisman @EllenChisman
Good points :-) #otalk @OTizzie
Bill Wong, OTD, OTR/L @BillWongOT
@preston_jenny @NikkiDanielsOT It means to me that it is a study that is considered as a test of concept- evidence might be scarce. #otalk
OTalk @OTalk_
Anyone any experience of doing this? #Otalk
Dr Jenny Preston MBE @preston_jenny
You sound like you have some experience of this @emmaspellmanOT, is there any good advice that you can share with others #OTalk @NikkiDanielsOT
Bill Wong, OTD, OTR/L @BillWongOT
RT @hooper_ek: I was involved in a field trial where we were testing the feasibility, acceptability & tolerability of a complex interventio…
Suzanne Henshall @Suze17
@OTalk_ I was the ‘treating OT’ for a feasibility /pilot study being undertaken from Nottingham University on early intervention Vocational Rehab in traumatic Brain injury. #otalk
Dr Jenny Preston MBE @preston_jenny
What did the feasibility study tell you @hooper_ek and how did that inform your actual study #OTalk @NikkiDanielsOT
Dr Jenny Preston MBE @preston_jenny
RT @emmaspellmanOT: @OTalk_ Previous research required closed questions in a survey, in pilot I asked open ended questions in interviews &…
Nikki Daniels @NikkiDanielsOT
@emmaspellmanOT @OTalk_ Great example Emma. Do you think sometimes this way of using a pilot study is confused with mixed methods research? #otalk
OTEmmaS @emmaspellmanOT
teeny tiny experience compared to OT researchers in our wide OT community of practice @preston_jenny - I will continue to tweet what potential useful nuggets spring to mind #OTalk
OTalk @OTalk_
RT @preston_jenny: You sound like you have some experience of this @emmaspellmanOT, is there any good advice that you can share with others…
Dr Jenny Preston MBE @preston_jenny
Do you have any learning to share with us @Suze17 #OTalk @NikkiDanielsOT
Alex Smith @YmchwilStroc
@LynneGoodacre Definitely, feasibility is a catch all term for the evaluation of pilot studies. Others have mentioned other important concepts which sit under this feasibility umbrella e.g adherence, acceptability. I think we can be clear that pilot studies don’t evaluate effectiveness #OTalk
OTEmmaS @emmaspellmanOT
oooh, never thought of it that way @NikkiDResearch. for me its a definite means of testing a part of whole of research design #OTalk
Dr Jenny Preston MBE @preston_jenny
@emmaspellmanOT Brilliant @emmaspellmanOT we are all learning and all experiences are equally valid #Otalk @NikkiDanielsOT
Nikki Daniels @NikkiDanielsOT
Can you elaborate @BillWongOT What do you mean by test of concept? #OTalk
Dr Jenny Preston MBE @preston_jenny
RT @YmchwilStroc: @LynneGoodacre Definitely, feasibility is a catch all term for the evaluation of pilot studies. Others have mentioned oth…
Emma Hooper @hooper_ek
It led to tweaks to the outcome measures, the intervention materials and the study sites. It was useful. #otalk @preston_jenny @OTalk_
Michelle Perryman @Symbolic_Life
RT @preston_jenny: Might there be specific aspects of the research/trial that you might wish to test @mirnoonanOT #OTalk https://t.co/dXLP…
OTEmmaS @emmaspellmanOT
RT @preston_jenny: @emmaspellmanOT Brilliant @emmaspellmanOT we are all learning and all experiences are equally valid #Otalk @NikkiDaniels
Bill Wong, OTD, OTR/L @BillWongOT
@NikkiDanielsOT test of concept means- the concept has not been proven, as it is still in exploratory stages. #otalk
Dr Lynne Goodacre @LynneGoodacre
Here's a link to an NIHR document that explains the diff between feasibility and pilot studies for anyone interested https://t.co/BEN1z4nvox #otalk
Miriam Noonan @mirnoonanOT
@NikkiDanielsOT @emmaspellmanOT @OTalk_ A very interesting point! #OTalk
Miriam Noonan @mirnoonanOT
RT @LynneGoodacre: Here's a link to an NIHR document that explains the diff between feasibility and pilot studies for anyone interested htt…
Dr Jenny Preston MBE @preston_jenny
RT @LynneGoodacre: Here's a link to an NIHR document that explains the diff between feasibility and pilot studies for anyone interested htt…
Nikki Daniels @NikkiDanielsOT
@YmchwilStroc @LynneGoodacre Definitely not a purpose, often misunderstood! Run before you can walk! #otalk
Emma Hooper @hooper_ek
I wonder if anyone who has identified the need for changes during a pilot / feasibility then re-pilots the altered protocol or whether you go straight onto the wider scale study? #otalk @preston_jenny @OTalk_
Ellen Chisman @EllenChisman
Thank you for this :-) #otalk @LynneGoodacre
Dr Jenny Preston MBE @preston_jenny
Great discussion tonight and we’ve already started to consider this but what are the main benefits observed from pilot studies? #OTalk @NikkiDanielsOT
Nikki Daniels @NikkiDanielsOT
@emmaspellmanOT @NikkiDResearch I think it's both and essential those closed questions evolve transparently. I used focus group data to develop a closed questionnaire but mine is a 2 phase mixed methods study #OTalk
Dr Jenny Preston MBE @preston_jenny
RT @hooper_ek: I wonder if anyone who has identified the need for changes during a pilot / feasibility then re-pilots the altered protocol…
OTalk @OTalk_
Any thoughts? #OTalk
Alex Smith @YmchwilStroc
@NikkiDanielsOT @LynneGoodacre Do you think questionnaire ‘piloting’ in this sense sits neatly in the pilot study mould? In essence construct and content validity are about questionnaire effectiveness #OTalk
OTalk @OTalk_
Thanks for sharing @LynneGoodacre Download and add to your reading list #Otalk
Ellen Chisman @EllenChisman
I think it depends on extent to which you are making changes? May be a good idea. I was told if they are substantial then for one thing you may need to go through ethics again. #otalk @hooper_ek
Dr Lynne Goodacre @LynneGoodacre
Hmm interesting point @hooper_ek when I piloted a questionnaire we made some changes as a result of the pilot and tried it out with a few people but not as many as the original pilot #OTalk I guess the question is at what point do you stop piloting
Will Chegwidden @willchegwidden
@EllenChisman @LynneGoodacre Feasibility Studies are pieces of research done before a main study in order to answer the question “Can this study be done?”; Pilot studies are a version of the main study that is run in miniature to test whether the components of the main study can all work together. #OTalk
OTEmmaS @emmaspellmanOT
in my limited practical experience but knowledge from study I think that, right there is a great use of a pilot, I think I'm doing something similar pilot focus group analysed results will shape a questionnaire and one to one interviews #OTalk
Will Chegwidden @willchegwidden
(From the document posted by @LynneGoodacre - great summary #OTalk
OTEmmaS @emmaspellmanOT
RT @NikkiDanielsOT: @emmaspellmanOT @NikkiDResearch I think it's both and essential those closed questions evolve transparently. I used foc…
Dr Jenny Preston MBE @preston_jenny
Good question @YmchwilStroc and does that introduce a potential difference in the use of 'piloting' between quantitative and qualitative methodologies (somewhat provocative here, sorry) #OTalk @NikkiDanielsOT
Miriam Noonan @mirnoonanOT
@hooper_ek @preston_jenny @OTalk_ The RCT that I am using for secondary analysis piloted the intervention and made some tweaks. One example being one resource was titled: caregivers resource and the feedback was that is should be changed to family and friends resource which it was for the main trial #OTalk
Suzanne Henshall @Suze17
@preston_jenny @NikkiDanielsOT There were things highlighted that hadn’t been anticipated or eg difficult recruiting pts in some sites, challenges associated in working across different organisations & clinicians interpreting things differently in different sites-all good learning & informd alterations?#OTalk
OTEmmaS @emmaspellmanOT
RT @OTalk_: Thanks for sharing @LynneGoodacre Download and add to your reading list #Otalk https://t.co/8csKqeYufI
OTEmmaS @emmaspellmanOT
RT @OTalk_: Any thoughts? #OTalk https://t.co/joIpfKs5yU
Dr Jenny Preston MBE @preston_jenny
Well that answers that question @willchegwidden, great succint summary #OTalk @NikkiDanielsOT
Dr Lynne Goodacre @LynneGoodacre
I agree @YmchwilStroc I see construct and content validity as something which is tested in the main study #OTalk
Dr Jenny Preston MBE @preston_jenny
Good example @mirnoonanOT thank you for sharing #OTalk @NikkiDanielsOT
Bill Wong, OTD, OTR/L @BillWongOT
RT @willchegwidden: @EllenChisman @LynneGoodacre Feasibility Studies are pieces of research done before a main study in order to answer the…
OTEmmaS @emmaspellmanOT
RT @mirnoonanOT: @preston_jenny What first comes to mind is the outcome measures, how many and what outcomes to measure, is what I’m thinki…
Emma Hooper @hooper_ek
Exactly @LynneGoodacre ... I guess it’s coming to a collaborative decision to move forwards rather than perpetually piloting #OTalk
Claire Murphy @Incredhead
@LynneGoodacre @BJOTeditor Sorry forgot the #OTalk
Dr Jenny Preston MBE @preston_jenny
Excellent examples @Suze17, this is exactly what the pilot study is intended to do #OTalk @NikkiDanielsOT
Claire Murphy @Incredhead
RT @LynneGoodacre: Here's a link to an NIHR document that explains the diff between feasibility and pilot studies for anyone interested htt…
Dr Jenny Preston MBE @preston_jenny
RT @LynneGoodacre: I agree @YmchwilStroc I see construct and content validity as something which is tested in the main study #OTalk https:/…
Miriam Noonan @mirnoonanOT
@preston_jenny @NikkiDanielsOT @OTalk It was a great learning experience and opened my eyes to the importance of why pilot studies are important. #OTalk
Andrew Bateman @DrAndrewBateman
RT @LynneGoodacre: Here's a link to an NIHR document that explains the diff between feasibility and pilot studies for anyone interested htt…
Dr Jenny Preston MBE @preston_jenny
RT @hooper_ek: Exactly @LynneGoodacre ... I guess it’s coming to a collaborative decision to move forwards rather than perpetually piloting…
OTEmmaS @emmaspellmanOT
I think I am missing lots of tweets from participants to this chat - having IT trouble perhaps - looking forward to seeing these at some point and continuing the learning #OTalk
OTalk @OTalk_
RT @preston_jenny: Excellent examples @Suze17, this is exactly what the pilot study is intended to do #OTalk @NikkiDanielsOT https://t.co/K…
OTalk @OTalk_
@Incredhead @LynneGoodacre @BJOTeditor Happens to the best of us 😀 #Otalk
OTEmmaS @emmaspellmanOT
RT @preston_jenny: Excellent examples @Suze17, this is exactly what the pilot study is intended to do #OTalk @NikkiDanielsOT https://t.co/K…
Bill Wong, OTD, OTR/L @BillWongOT
RT @OTizzie: @EllenChisman I think that is one really big distinction yes! And there are different areas that can be addressed to identify…
Dr Jenny Preston MBE @preston_jenny
It is hard to keep up @emmaspellmanOT, I'm stuggling a bit tonight too but the discussion is great with some fantastic examples of learning and sharing #OTalk @NikkiDanielsOT
OTalk @OTalk_
Lots of great discussions going on tonight @emmaspellmanOT so it is hard to keep up! The transcript will help if we've all been good and used the #Otalk 😀
OTalk @OTalk_
RT @preston_jenny: It is hard to keep up @emmaspellmanOT, I'm stuggling a bit tonight too but the discussion is great with some fantastic e…
Dr Jenny Preston MBE @preston_jenny
Where is the time going tonight? Are we ready for Question 4 What, if any, are the challenges in relation to pilot studies? #OTalk @NikkiDanielsOT
OTEmmaS @emmaspellmanOT
RT @preston_jenny: It is hard to keep up @emmaspellmanOT, I'm stuggling a bit tonight too but the discussion is great with some fantastic e…
OTalk @OTalk_
RT @preston_jenny: Well that answers that question @willchegwidden, great succint summary #OTalk @NikkiDanielsOT https://t.co/nkUQs0m3Jh
Andrew Bateman @DrAndrewBateman
#OTalk I have just noticed, are discussing research. the next meeting with BSRM in October in Warwick promises to be a great event...
OTEmmaS @emmaspellmanOT
@preston_jenny @NikkiDanielsOT Switching to Mac now but it might be network #OTalk @OTalk_ 🙋🏻
OTalk @OTalk_
It's been a great discussion and its going fast! Any challenges to share? #Otalk
OTEmmaS @emmaspellmanOT
RT @OTalk_: It's been a great discussion and its going fast! Any challenges to share? #Otalk https://t.co/0yemlzJRsl
Bill Wong, OTD, OTR/L @BillWongOT
lurking for the remainder of the check... see you guys next week. #otalk
Dr Lynne Goodacre @LynneGoodacre
When you're recruiting from a small pool of potential participants not using them all up in the pilot #OTalk
Emma Hooper @hooper_ek
We realised that we’d included a caregiver measure that was validated for over 65s but some caregivers were adult children under 65y/o so needed to be replaced. #OTalk @mirnoonanOT @preston_jenny
Miriam Noonan @mirnoonanOT
@preston_jenny @NikkiDanielsOT Time! #OTalk
Ellen Chisman @EllenChisman
Q4 time, resources, knowing what to do afterwards with what you have found/learnt. As mentioned earlier, when do you stop piloting. Maybe designing it as well if some things are to be found/developed e.g. in grounded theory #OTalk
Dr Jenny Preston MBE @preston_jenny
Thanks @ozcboss #OTalk discusses research on the first Tuesday of the month. Do join us or perhaps you might even consider hosting a chat.
OTalk @OTalk_
@ozcboss Thanks for sharing. First Tuesday of every month our chat focuses on a research topic so feel free to join us #Otalk
Claire Murphy @Incredhead
@preston_jenny @NikkiDanielsOT My colleague and I conducted a small pilot physical health and exercise programme in a first episode psychosis service. There were feasibility elements to it but we wanted to test all elements of the study and intervention and used it to apply for subsequent funding #Otalk
Dr Jenny Preston MBE @preston_jenny
Very good point @LynneGoodacre #OTalk @NikkiDanielsOT
Dr Jenny Preston MBE @preston_jenny
Another excellent example, thanks for sharing @hooper_ek #OTalk @NikkiDanielsOT
OTEmmaS @emmaspellmanOT
@OTalk_ Q4: When you ask a question in the pilot and there’s an uncomfortable silence, can feel bad but useful as you know not to ask that in the real study or modify it #OTalk
OTEmmaS @emmaspellmanOT
@preston_jenny @OTalk_ @NikkiDanielsOT Q3: current pilot proving useful to practice the data analysis method in my current pilot that I will use for main #OTalk
Izzie LR @OTizzie
RT @OTizzie: @OTalk_ Anyone confused between pilot/feasibility?! While writing my diss. I realised the terms are often misused. I think a p…
OTEmmaS @emmaspellmanOT
@preston_jenny @OTalk_ @NikkiDanielsOT Q3: Pilot also useful for building up trust with potential participants in the ‘real’ study #OTalk
Emma Hooper @hooper_ek
I’m wondering if anyone has experienced challenges with publishing the outcomes of pilot studies? #otalk @preston_jenny @OTalk_
Izzie LR @OTizzie
RT @OTizzie: @EllenChisman I think that is one really big distinction yes! And there are different areas that can be addressed to identify…
Dr Jenny Preston MBE @preston_jenny
Were you successful with the funding bid @Incredhead and were you able to conduct the study? #OTalk @NikkiDanielsOT
Shirley Reynolds #FBPE @DrS_Reynolds
RT @LynneGoodacre: Here's a link to an NIHR document that explains the diff between feasibility and pilot studies for anyone interested htt…
Theresa Travis @s9tmt
RT @preston_jenny: Another excellent example, thanks for sharing @hooper_ek #OTalk @NikkiDanielsOT https://t.co/wAhHsFizk5
Dr Lynne Goodacre @LynneGoodacre
Design in a great point for sure - needing to be clear about exactly what you are wanting to find out through the pilot and ensuring its design will explore those issues #OTalk
Nikki Daniels @NikkiDanielsOT
I used a group of PhD researchers to pilot focus group. Fabulous learning and made essential changes. Used this group so as not to pull from a potentially small population in the main study. Turned out the first real focus group with the real participants was greater value #OTalk
Dr Jenny Preston MBE @preston_jenny
RT @emmaspellmanOT: @preston_jenny @OTalk_ @NikkiDanielsOT Q3: current pilot proving useful to practice the data analysis method in my curr…
Nikki Daniels @NikkiDanielsOT
I guess theres a temptation not to pilot if short on time?!? Not condoning it....just saying! #OTalk
Dr Jenny Preston MBE @preston_jenny
I feel like I’m rushing now but now for our final question of the night. How do you know if you have done enough piloting to execute a larger scale study? #OTalk @NikkiDanielsOT
Miriam Noonan @mirnoonanOT
@NikkiDanielsOT That’s the worry isn’t it. I’ve heard this being discussed before! #OTalk
Izzie LR @OTizzie
RT @preston_jenny: Good point @OTzzie, even the MRC Framework for evaluation complex interventions uses the terms interchangeably #OTalk ht…
Alex Smith @YmchwilStroc
@NikkiDanielsOT @LynneGoodacre I’ve not seen the term pilot or feasibility applied in ‘questionnaire’ or PROMs research as you would need a pre-defined sample size etc. to determine construct or content validity. Too small a sample and the stats won’t work. So not really piloting #OTalk
Nikki Daniels @NikkiDanielsOT
So in effect I did 2 pilots! #otalk #phdlearning
Cara Lawrence @caralawrence
This is all looking really interesting just joined will have to have a look through! #otalk
Faith Martin @fam6
RT @LynneGoodacre: Here's a link to an NIHR document that explains the diff between feasibility and pilot studies for anyone interested htt…
Dr Lynne Goodacre @LynneGoodacre
we reported this in the paper for the main study rather than as a paper in it's own right #OTalk
Emma Hooper @hooper_ek
Or perhaps there is also a risk that pilot studies don’t go beyond this stage into a wider study? #otalk @NikkiDanielsOT @preston_jenny
OTalk @OTalk_
Last question of the evening! #Otalk
Dr Jenny Preston MBE @preston_jenny
RT @LynneGoodacre: we reported this in the paper for the main study rather than as a paper in it's own right #OTalk https://t.co/po3kr4OCOe
OTalk @OTalk_
@caralawrence Its been a very informative chat. Lots of questions answered and raised #Otalk
Claire Murphy @Incredhead
@mirnoonanOT @preston_jenny @NikkiDanielsOT Also money/funding. We convinced our management team to provide limited funds for a small pilot study and used this to leverage additional funding for a subsequent larger study. However this was not enough to implement all our learning and recommendations from pilot #Otalk
OTEmmaS @emmaspellmanOT
RT @preston_jenny: Another excellent example, thanks for sharing @hooper_ek #OTalk @NikkiDanielsOT https://t.co/wAhHsFizk5
OTEmmaS @emmaspellmanOT
RT @preston_jenny: Very good point @LynneGoodacre #OTalk @NikkiDanielsOT https://t.co/vnvjehDIYR
Dr Jenny Preston MBE @preston_jenny
Its been a great chat tonight @caralawrence some excellent real life examples being shared. I can't wait to read the transcript #OTalk @NikkiDanielsOT
OTEmmaS @emmaspellmanOT
RT @LynneGoodacre: we reported this in the paper for the main study rather than as a paper in it's own right #OTalk https://t.co/po3kr4OCOe
Nikki Daniels @NikkiDanielsOT
@hooper_ek @preston_jenny Good point. I'm sure both happen a lot! #OTalk
Dr Jenny Preston MBE @preston_jenny
I think that is a very real risk @hooper_ek and such a pity #OTalk @NikkiDanielsOT
Nikki Daniels @NikkiDanielsOT
@YmchwilStroc @LynneGoodacre Interesting Alex. I'm going to have to revisit this tomorrow and get my thinking cap on. I engaged a statistician in my protocol and calculated the sample size needed. It was a strict requirement by my supervisory team #OTalk
OTEmmaS @emmaspellmanOT
@OTalk_ Q5: I'm reliant right now on my brilliant PhD supervisors, I'm constructing a pilot report and will await their guidance on sufficiency or not #OTalk
OTalk @OTalk_
RT @preston_jenny: I think that is a very real risk @hooper_ek and such a pity #OTalk @NikkiDanielsOT https://t.co/0wEtPhSPqo
Dr Lynne Goodacre @LynneGoodacre
before you even get to using the questionnaire in the main study @YmchwilStroc questionnaires are usually piloted, once the items have been generated, with a small number of people to check that the questions can be understood etc etc #OTalk
Alex Smith @YmchwilStroc
@preston_jenny @NikkiDanielsOT When you succesfully obtain funding to run the large scale trial? 😆 #OTalk
OTalk @OTalk_
5 minute warning. Keep the comments coming. So much learning tonight #OTalk
Nikki Daniels @NikkiDanielsOT
RT @OTalk_: 5 minute warning. Keep the comments coming. So much learning tonight #OTalk
OTEmmaS @emmaspellmanOT
@OTalk_ Q5: the only other consideration I have is going back to purpose of pilot and whether or not pilot, in the end, has met that, perhaps this might guide thoughts on sufficiency #OTalk
Cara Lawrence @caralawrence
@preston_jenny @NikkiDanielsOT Really interesting! I am wondering where to go next in the research career! (Early days) but such an important part of our work #otalk
Emma Hooper @hooper_ek
Sorry jumped the gun on this question with my previous comment about perpetual piloting! Possibly the requirements of the funders / timeline help to move it forwards in a timely way. #otalk @preston_jenny @OTalk_
Dr Jenny Preston MBE @preston_jenny
As a PhD supervisor we always get the blame!! What factors do you think might be taken into consideration? #OTalk @NikkiDanielsOT
OTalk @OTalk_
#OTalk – 12th February 2019 – TBI and Cognitive rehabilitation: https://t.co/j30ROg7laZ
Claire Murphy @Incredhead
@preston_jenny @NikkiDanielsOT Initial funding was 10 participants for 8 week pilot from management team. Dietitian & Physios gave support for free for pilot. Based on the report we got yearly funding for 24 people but not enough to buy in dietitians. Physio was able to continue to help out at no cost #otalk
OTalk @OTalk_
The pilot study can be a very important part of the research process so thanks you to everyone for your contributions; it is great to have learnt so much this evening and have some reading to do to learn some more #OTalk
OTEmmaS @emmaspellmanOT
PhD supervisors rock @preston_jenny hugely grateful for time and support, hard job #OTalk
Alex Smith @YmchwilStroc
@LynneGoodacre Definately! I find these tend to be more qualitive, focus group type explorations as opposed to statistical analyses of construct validity etc. Would be interested if you have contrary examples #OTalk
Dr Jenny Preston MBE @preston_jenny
Can't argue with that @YmchwilStroc. Sounds like you have been successful with your finding bid. Congratulations #OTalk @NikkiDanielsOT
Dr Lynne Goodacre @LynneGoodacre
thanks also to @NikkiDanielsOT and @preston_jenny for making us think at this time of night! #otalk
Angelyn Easton @AngelynJEaston
@OTalk_ Thanks all this was really interesting to follow! #OTalk
OTalk @OTalk_
That's it folks! Please do keep chatting. Thank you very much to @preston_jenny for leading with tonight's questions. Goodbye from @NikkiDanielsOT on the #Otalk account
Ellen Chisman @EllenChisman
Thank you to the hosts and to everyone for sharing your thoughts and experiences. Good discussion! #otalk
Dr Jenny Preston MBE @preston_jenny
It's a brilliant job! I learn so much from my PhD students and I'm always so proud of their achievements #OTalk @NikkiDanielsOT
Theresa Travis @s9tmt
RT @preston_jenny: I think that is a very real risk @hooper_ek and such a pity #OTalk @NikkiDanielsOT https://t.co/0wEtPhSPqo
OTalk @OTalk_
@EllenChisman Thank you for joining us #Otalk
Dr Lynne Goodacre @LynneGoodacre
can't think of any contrary examples at the moment @YmchwilStroc certainly qual but when I've done this it's been more 1:1 than focus groups #Otalk
Claire Murphy @Incredhead
@hooper_ek @NikkiDanielsOT @preston_jenny Also in clinical settings the learning from pilot studies is not shared more widely so other services do not have the opportunity to learn from the pilot or develop a larger study. Or the report never even gets written up! #otalk (May or may not be talking from experience!!)
#OTalk content from Twitter.