Report CopyRight/DMCA Form For : An Introduction To Research Methods Needs Assessment
20 November 2013An Introduction toResearch Methods Needs Assessment Surveys Focus Groups.and PersonasPrepared for the ULS LeadershipProgram byLuke Ferdinand John Fudrow KarenCalhoun and Jeff Wisniewski.This work is licensed under aCreative Commons Attribution NonCommercial NoDe... 3 0 Unported License Agenda Topic TimeArrival 10 25 10 35 amIntroduction to the workshop 10 35 10 45 am.Needs assessment Luke 10 45 am 12 00 pmBox lunches 12 00 12 30 pmSurveys John 12 30 1 30 pmShort break 1 30 1 40 pmFocus groups 1 40 2 40 pm.Short break 2 40 2 50 pmPersonas research Jeff 2 50 3 50 pmWrap up and get on shuttle 3 50 4 00 pmAssessmentDefining and Addressing The Needs of an.Organization and Its AudienceLuke FerdinandULS Leadership Program20 November 2013Objectives. Define Needs in Organization Define Needs Assessment Understand the methods and tools used in NeedsAssessment Know potential risks in Needs Assessment methods.ULS Research Methods WorkshopWhat is a Needs Assessment A systematic process for collecting information and makingjustifiable decisions Ryan WatkinsRyan Watkins 2013 Needs.ULS Research WorkshopMethods Gaps inResults http ryanrwatkins com na naintroduc... What is a need . Needsare the differences between your currentachievements and your desired accomplishments Ryan Watkins 2013 NeedsULS Research GapsMethods in.Results http ryanrwatkins com na naintroduc... Needs Assessments Help Identify Data that define your needs Prioritization of your needs. Criteria for implementing solutions Information necessary to justify selection of one ormore activities to improve performanceRyan Watkins 2013 Needs Gaps inResults ULS Research Methods Workshop.http ryanrwatkins com na naess... Provide a systematic process to guide decision making inorganizations Provide justification for decisions before they are made Scalable for any size project time frame or budget . Offer a replicable model that can be applied by novices or Provide a systemic perspective for decision makers Allow for interdisciplinary solutions for complex problems Ryan Watkins 2013 NeedsULS Research Gaps.Methods in Results http ryanrwatkins com na naess... Where can we use a needs assessment Strategic Action 9a Ground Floor Needs Assessment obviously . Opportunity to rethink the ground floor Many assumptions and ideas for what s best Gather information from stakeholders relevant Make an informed decision to best meet the needs oforganization and community. Other opportunities ULS Research Methods WorkshopBrought to you by the National Oceanic AtmosphericAdministrationhttp csc noaa gov needs .ULS Research Methods WorkshopNeeds Assessment Steps1 Confirm the Issues 7 Determine Your SamplingAudience Scheme2 Establish the Planning Team 8 Design and Pilot the.3 Establish the Goals and Collection InstrumentObjectives9 Gather Report Data4 Characterize Your Audience10 Analyze Data.5 Conduct Information Literature Search 11 Manage Data6 Select Your Data Collection 12 Synthesize Data Createmethods ReportULS Research Methods Workshop.1 Confirm Issues Audience Summary Establish purpose of assessment and summarize Questions Is this a new issue or audience for the organization . Is there agreement up the organizational chain this issue oraudience needs to be addressed Risks Unknown stakeholders Communication issues. LACK OF SUPPORTULS Research Methods Workshop2 Establish the Planning Team All steps should be conducted with planning team Ideally members of stakeholder groups and experts. Communication is essential Consider resource needs time expertise etc Questions Are the stakeholders new or well known How will geography impact planning . Expertise within the team Sense of ownership Communication Planning can overtake actionULS Research Methods Workshop.3 Establish Goals and Objectives Summary Identify the desired and actual levels of knowledge or skill Identify cause s for the lack of knowledge or skill Devise solution s . Questions Are the goals widely shared by the audience Are your objectives measurable Will the project be considered a success if the objectives are met Risks . Potential to disengage by different team members who have different priorities Not knowing if goals have been achieved and to what degree Long term support for doing needs assessmentsULS Research Methods Workshop Play Time.4 Characterize Your Audience Summary Sample size Skill knowledge level Educational Level. Attitudes and biases Questions How long have you worked with the audience How much variation is there within the audience Risks . Assumptions can backfire Broadly generalizing and audience can lead to failureULS Research Methods WorkshopTopics for AudienceCharacterization. Knowledge Training Tools Techniques Benefits Attitudes Biases. Ability to Attend or Access Cultural CharacteristicsULS Research Methods Workshop5 Information Literature Search Summary. Environmental Scan Readings Surveys to address questions raised in review Questions Has this audience or issue been surveyed in the past . What other ways might we find useful information about this audience or issue Risks Results may be outdated Redundant effort wasted time Missing important information that may make results easier or better.ULS Research Methods Workshop6 Select Your Data Collection methods Summary Observation Personal Interviews. Surveys Focus Groups Questions Have all methods been considered Consider audience characteristics when drafting collection methods. How much expertise is there in house Seek help Risks Can be intrusive or upsetting Time spent designing vs time spent analyzingULS Research Methods Workshop.7 Determine Your Sampling Summary Sample more than you think you need Questions What is statistically recommended . What is the population size of audience Risks Likely not scientifically sound Too many or too few in sampleULS Research Methods Workshop.Exercise Develop Your GoalsDiscuss how you would approachAudience CharacterizationData Collection MethodsSample Size.Measure of SuccessULS Research Methods Workshop8 Design and Pilot Your CollectionInstrument Summary. Pilot first to identify weaknesses Questions How will you pilot your instrument What kind of expertise is on your planning team How important is statistical precision . How will data collection be standardized Risks Instrument will not be clear or gather necessary data The audience will not be receptive to the survey instrument Asking too many questions may irritate the respondents.ULS Research Methods Workshop9 Gather and Record Data Summary Find means to incentivize respondents survey prizes etc Ensure anonymity if this is a priority to audience. Coordinate with assessment team If audience is outside of library make use of External Communications group Questions Will you recruit people outside planning team to assist in data gathering Are you getting the desired response rate . Risks Data will be biased Language or vocabulary issues Invalid StudyULS Research Methods Workshop.10 Analyze Data Summary Keep findings and interpretation of findings separate in reporting Questions Seek assistance in interpreting data if necessary. Risks Under or over whelming audience with report Missing trends and patterns Not accounting for possible critical barriers Letting bias slip into the process.ULS Research Methods Workshop11 Manage Data Summary This step involves determining how data will be organized and archived The importance of this step is often not recognized until it is too late . Questions Will this data ever need to be referred to again Will the raw data be stored How will it be stored Can should the data be shared Risks . There may be unforeseen reasons that would necessitate the data beingused again Inadequate metadataULS Research Methods Workshop12 Synthesize Data and Create Report. Always address your goals and objectives in synthesis Report mustinclude problems or errors with the design and the implementation ofthe survey An executive summary is often helpful Questions Who is the audience for the report . Did you address your objectives Risks Potential to disengage by different team members who have differentpriorities Not knowing if goals have been achieved and to what degree. Long term support for doing needs assessmentsULS Research Methods WorkshopGather your Data ReportULS Research Methods WorkshopThank you .Works Cited http www cscnoaa gov needshttp ryanrwatkins com na includes link to free NA eBook Additional Reading http en wikipedia org wiki Nee... .ULS Research Methods Workshop Survey BasicsSurvey MonkeyJohn FudrowULS Leadership Program.20 November 2013When to Use a Survey Explore a Topic Discussion with Target Population Gather Objective Data on Subject. Benchmarking of Service LevelsULS Research Methods WorkshopSurvey Monkey Templates Over 150 pre made templates Variety of topics. Community 2 Customer Feedback 7 Demographics 9 Education 20 Events 7 . Healthcare 14 Human Resources 18 Industry Specific 58 Just for Fun 9 Market Research 12 . Non profit 5 Political 11 ULS Research Methods WorkshopSurveys We Have Applied ULS General Survey. Library Instruction Survey E book Survey Event Feedback Surveys Internal PlanningULS Research Methods Workshop.Types of Survey Questions Open Ended Closed EndedULS Research Methods WorkshopTypes of Survey Questions. Open Ended i Single Textbox ii Multiple Textboxes iii Comment Essay Box iv Numerical Textboxes. v Demographic U S or International vi Date and or TimeULS Research Methods WorkshopTypes of Survey Questions Close Ended. i Multiple Choice Only One Answer Allowed ii Multiple Choice Multiple Answers Allowed iii Rating iv Ranking v Matrix of Choices Only One Answer Per Row . vi Matrix of Choices Multiple Answers Per Row vii Matrix of Drop down menusULS Research Methods WorkshopLikert Scales and Ratings What is a Likert Scale . A scaled response of a respondents feelings toward atopic based on a presented scale ULS Research Methods WorkshopLikert Scales and Ratingswording of response choices . Number of choices to relevancy 5 to 7 choices allow for a consistent distribution The third choice should be the undecided or neutral Becareful not to force ranking by the wording of thebase question .ULS Research Methods Workshop IRB Authorization ServiceImprovement Anonymous Ratings. Do not store data publicallyULS Research Methods WorkshopSurvey Delivery Target your audience Multiple avenues for large samples. Create Multiple links to analyze effectiveness ofdelivery methods DON T SPAM You cannot mass emailULS Research Methods Workshop.Statistical Relevance and You We are not statisticians We don t have the resources nor time to run full analysis Our reports are not statistically relevant Our analysis is focused on report fulfillment. We don t properly sample Our audience is often expert library users This alters the influence of their input We don t run via SPSS Statistical Package for the Social Sciences.ULS Research Methods WorkshopUsing Survey Monkey Free Version https www surveymonkey com Create a free accountULS Research Methods Workshop.Survey Monkey Free Version Limitations 10 Questions 100 Responses No Page Logic. 20 Less Templates No CustomizationULS General Survey. Library Instruction Survey. E-book Survey. Event Feedback Surveys. ... awareness and usage of library instruction services (inside and outside the library, onsite and virtual) Exercise. ... and information on developments in her field. uses .