What is the purpose of the CMU Research Review Application Process?, Complete MSA Capstone Discussion Post

User Generated

Gnfunypceb

Humanities

Description

DISCUSSION 1: This for the MSA class you've been helping out with about Liberty House and why the percentage of clients who attend counseling drops after leaving the facility.

You will find most of the answers to these questions in the attachments below...One is the Review Application and the other is the MSA Guide to the Capstone Project. Please answer the questions correctly.


  1. When you complete your individual research project do you think you will be more likely to use descriptive statistics or some other statistical method? Explain how you plan to analyze your data.


  1. What is the purpose of the CMU Research Review Application Process? ( The ultimate goal is to insure human subject protection. The reviewer will determine that nothing in the proposed project constitutes an unacceptable level of risk....elaborate...RRA Tips attachment will help more with this answer...please don't copy)


  1. Which students do not have to complete the Review Process?


  1. Review the Research Review Application. Which of the two categories best fit your individual research project? Which attachments will be needed for your individual research project? Why? (Hint: If you read Lecture this last part will be easier to answer)


  1. On the second page of the Application, which box will you select for your individual research project (My project is related to my MSA concentration) ? If you have to complete the text box, what will you say in that box (Explain that this research is conducted in your concentration of MSA and work with social work....elaborate)?


  1. Will you need to include an organizational permission letter with your application? (YES) Why or why not(because I will be surveying clients...elaborate that info)? If yes, are you confident that you can obtain a permission letter (YES)?


Unformatted Attachment Preview

RESEARCH REVIEW APPLICATION FOR MSA 699 AND EDU 776 CAPSTONE COURSE PROJECT Project title: _________________________________________________________________________________________________ Student name: ___________________________________________________________ Student ID#: _______________________ E-mail address:_________________________ Work phone: _______________________ Home phone: _______________________ Concentration: _______________________________________________________________________________________________ Instructor’s name: __________________________________________ Instructor e-mail: ___________________________________ Course: _______________________________ EPN: ________ Program center: ________________________________________ Do you intend to use human subjects or human subjects data in your project? Yes  No  Do you intend to publish your project or present project results outside of your organization? Yes  No  If you answered “yes” on both questions, you are required to complete CITI training and seek approval through CMU’s Institutional Review Board (IRB). The IRB process requires registration in IRBNet and submission of your application materials and supporting documents through IRBNet. Please consult with your instructor and the appropriate program office for assistance. If you answered “no” to one or both questions, you may use this form for your research review. Read the following directions: Non-human subject research Human subjects research In the box below describe the purpose of your research, describe the data you plan to use, and specify the sources of your data (URL, organizational source, etc.) Required attachments: Permission letter on the organization’s letterhead if the data is not available to the general public. In the box below describe the purpose of your research; specify the source of your subject pool, the number of subjects, and the selection criteria. Specify your relationship to the subjects (co-worker, supervisor, work in same organization, etc.). Describe your research methodology. Required attachments: Copy of survey or interview questions, cover letter or consent form, permission letter on the organization’s letterhead if the subject pool is not selected from a public source such as a phone directory or web page. Routing: Student, Instructor, Program Office, Notification to Student/Instructor, Document Imaging/SLCM Coding ___ TEC ___ Prereqs ___ E-mail ___ SAP ___ Filemaker Page 1 Please check all that apply:  My project is work-related  My project is related to my concentration  My project is not related to my work or to my concentration. Please provide a rationale for a project that is not work-related or concentration-related: Directions: Insert digital signature or type in your name as verification/approval of the information presented in this application. Your signature also confirms your commitment to appropriate research ethics while conducting this research: Submit this form and applicable attachments to your instructor. Please wait for written approval prior to beginning data collection. Student signature: ___________________________________________________ Date: ____________________________________ Student signature: ___________________________________________________ Date: ____________________________________ (Please type or print your name.) Instructor signature: _________________________________________________ Date: ____________________________________ Instructor signature: _________________________________________________ Date: ____________________________________ (Please type or print your name.) Program approval signature: ___________________________________________ Date: ___________________________________ Program approval signature: ___________________________________________ Date: ___________________________________ (Please type or print your name.) Routing: Student, Instructor, Program Office, Notification to Student/Instructor, Document Imaging/SLCM Coding ___ TEC ___ Prereqs ___ E-mail ___ SAP ___ Filemaker Page 2 The Student Guide to the MSA Capstone Project Part 2: The Research Review Application Process, FAQs, MSA 699 Course Information, and Library Support Central Michigan University August 2012 Contents Introduction to the Research Review Application Process ........................................................................... 3 Flow Chart for the Research Review Application Process ............................................................................ 4 What do I need to submit to my instructor? ................................................................................................ 5 How do I insert my signature? ...................................................................................................................... 6 Introduction to the Research Review Application form ............................................................................. 10 Sample Research Review Applications for a project with no human subjects ........................................... 11 Sample Research Review Application for a project with human subjects and using a web-based survey 12 Sample consent form .................................................................................................................................. 14 Sample survey cover letter ......................................................................................................................... 16 Sample survey ............................................................................................................................................. 17 Sample Permission Letter ........................................................................................................................... 19 Sample project descriptions for the RRA form ........................................................................................... 20 Suggested text for permission letters ......................................................................................................... 22 FAQs ............................................................................................................................................................ 24 MSA 699 Procedures ................................................................................................................................... 30 Registration and Payment Procedures................................................................................................ 30 Course Workshop and your Project Monitor ...................................................................................... 31 The Project Reviewer .......................................................................................................................... 33 Your Final Grade .................................................................................................................................. 33 Grading/Assessment/Evaluation Rubric ............................................................................................. 33 Incomplete Grades (6 month maximum deadline) ............................................................................. 37 Expiration of RRA/IRB approvals ......................................................................................................... 37 Applying for Graduation...................................................................................................................... 37 Isolated Students ................................................................................................................................ 38 How is my project stored? .................................................................................................................. 38 Library Support ........................................................................................................................................... 39 THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 2 INTRODUCTION TO THE RESEARCH REVIEW APPLICATION PROCESS Effective August 1, 2010, research conducted in MSA 699 is no longer under the jurisdiction of CMU’s IRB office. This means that as of August 1st, IRBNet applications will not be accepted for MSA students. The exceptions to this policy are those cases where the student’s work involves human subjects and would be considered “research” under the federal guidelines. Projects which constitute “research” are those projects using human subjects that generate findings that can be generalized and that are intended from the outset of the project to be disseminated to a wider audience. For example, a student conducting a project and using human subjects with the intent to publish the findings or report the findings to a broader audience, i.e., state or regional, national or international conference or outside of the researcher’s organization, must complete CITI training and seek IRB approval. On the other hand, a student conducting a work-related project with human subjects and reporting the findings within the organization is not required to seek IRB approval. The IRB requirement has been replaced by the Research Review Application process. You will complete the Research Review Application form and submit the form along with appropriate attachments to your instructor. The application form is available in a fillable PDF version or a fillable WORD version. With either version, you need to complete the form, insert your signature, and do a “save as” with a unique name. Attach the form and any other supporting documents to an e-mail and e-mail all documents to your instructor. The application form is available at http://www.cel.cmich.edu/student/forms/default.html (or go to http://cel.cmich.edu and select student forms from the quick find menu) or http://www.cmich.edu/academics/graduate_studies/GSMasterofScienceinAdministration/GSThe Department/Pages/Research_Review.aspx Approval notifications will be sent by e-mail and data collection may only begin when that approval has been received. E-mail approvals will be sent by either Carol Kross or Kim Gribben. Please review the flow chart on the following page for a better understanding of the paperwork flow in MSA 699 with the new research review application process in place. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 3 THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 4 What do I need to submit to my instructor? Here are some general instructions (Be sure to provide sufficient detail on the application form): If surveys are planned, submit the following forms to your instructor: 1. Research Review Application found at http://www.cmich.edu/academics/graduate_studies/GSMasterofScienceinAdministrati on/GSTheDepartment/Pages/Research_Review.aspx 2. Copy of survey 3. Consent form or cover letter/see templates found at http://www.cmich.edu/academics/graduate_studies/GSMasterofScienceinAdministrati on/GSTheDepartment/Pages/Research_Review.aspx 4. Permission letter (signed and on the organization’s letterhead) If you do not have access to a scanner, please fax the letter to 989-774-2575. Send all information to your instructor by e-mail. In the subject line put Research Review Application/ For a project which involves non-human subjects data (for example, financial data, government policies, etc.) or data that is already summarized and de-identified, submit the following forms to your instructor: 1. Research Review Application found at http://www.cmich.edu/academics/graduate_studies/GSMasterofScienceinAdministrati on/GSTheDepartment/Pages/Research_Review.aspx 2. A signed permission letter on letterhead if the data is not available to the general public (If you do not have access to a scanner, please fax the letter to 989-774-2575) Send all information to your instructor by e-mail. In the subject line put Research Review Application/ If face to face interviews are planned, submit the following forms to your instructor: 1. Research Review Application found at http://www.cmich.edu/academics/graduate_studies/GSMasterofScienceinAdministrati on/GSTheDepartment/Pages/Research_Review.aspx 2. Copy of interview questions 3. Adult consent form or informal interview consent form (use the adult consent form if the interview is formal or you are interviewing individuals with whom you have a relationship/see templates found at http://www.cmich.edu/academics/graduate_studies/GSMasterofScienceinAdministrati on/GSTheDepartment/Pages/Research_Review.aspx 4. Permission letter (signed and on the organization’s letterhead) (If you do not have access to a scanner, please fax the letter to 989-774-2575) Send all information to your instructor by e-mail. In the subject line put Research Review Application/ THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 5 How do I insert my signature (instructions for creating a digital signature)? Your typed name will suffice as your signature. However, a digital signature may also be used. Here are the steps to create a digital signature on the Research Review Application form. First, click on the signature field and select “a new digital ID I want to create now.” Then, select “new PKCS#12 digital ID file.” THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 6 Type in your information and click “next.” Use the default location for the signature file or browse for a selection on your computer. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 7 Enter a password and then type in again as confirmation. Click “finish.” Enter your password again and click on “sign.” THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 8 You will be asked to save the form. Select a location on your computer and save the form under a unique name. Your digital signature will be inserted. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 9 If you make changes in your form, you will need to resave and replace your original document or save under a new name. The digital signature file is only saved on the computer where it was created. Once created, instructors can use the same digital signature on all Research Review Application forms. Introduction to the Research Review Application form: On the next pages you will see sample Research Review Application forms. Be sure to insert an e-mail address that you frequently check. The EPN is the section number of your course, such as 22131756. While your project description should not be lengthy, be sure to be specific in your description. Consider this a summary where you will either write about: 1. Purpose of the study 2. Type of data to be analyzed 3. Source of data Or, 1. Purpose of the study 2. A description of the subjects, how they are selected, and the researcher’s relationship to the subjects 3. A description of the methodology (in other words, how is the survey distributed and collected, or, is it a phone interview or a face to face interview?) See page 5 and the following samples to determine the appropriate attachments to send along with your RRA form. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 10 Sample Research Review Application for a project with no human subjects: RESEARCH REVIEW APPLICATION FOR MSA 699/699 AND EDU 776 CAPSTONE COURSE PROJECT A Comparison of Employee Insurance Plans at Mid-American Conference Universities Project title: Student name: Sally Researcher Student ID#: 25689 E-mail address: resea1sl@cmich.edu Work phone: 989-774-0000 Home phone: 989-772-000 Concentration: MSA-Human Resources Administration Instructor’s name: Dr. Albert Einstein Instructor e-mail: einst1aa@cmich.edu Course: MSA 699: EPN: 22120666 Program center: Main campus/Mt. Pleasant Do you intend to use human subjects or human subjects data in your project? Yes No X Do you intend to publish your project or present project results outside of your organization? Yes No X If you answered “yes” on both questions, you are required to complete CITI training and seek approval through CMU’s Institutional Review Board (IRB). The IRB process requires registration in IRBNet and submission of your application materials and supporting documents through IRBNet. Please consult with your instructor and the appropriate program office for assistance. If you answered “no” to one or both questions, you may use this form for your research review. Read the following directions: Non-human subject research Human subjects research In the box below describe the purpose of your research, describe the data you plan to use, and specify the sources of your data (URL, organizational source, etc.) Required attachments: Permission letter on the organization’s letterhead if the data is not available to the general public. In the box below describe the purpose of your research; specify the source of your subject pool, the number of subjects, and the selection criteria. Specify your relationship to the subjects (co-worker, supervisor, work in same organization, etc.). Describe your research methodology. Required attachments: Copy of survey or interview questions, cover letter or consent form, permission letter on the organization’s letterhead if the subject pool is not selected from a public source such as a phone directory or web page. The purpose of the study is to determine if improvements can be made to the existing employee benefit plan at Central Michigan University. The researcher will compare employee insurance plans at all MidAmerican Conference universities. The researcher will use the details of Employee insurance benefits/disability plans/life insurance plans/major medical plans/wellness programs that are found through Internet searches. Examples of data sources are as follows: http://www.utoledo.edu/depts/hr/index.html http://www.bsu.edu/payroll/benefits/ http://www1.kent.edu/hr/employeehandbook/benefits.cfm Please check all that apply: X My project is work-related X My project is related to my concentration My project is not related to my work or to my concentration. Please provide a rationale for a project that is not work-related or concentration-related: Directions: Type in your name as verification/approval of the information presented in this application. Your signature also confirms your commitment to appropriate research ethics while conducting this research: Submit this form and applicable attachments to your instructor. Please wait for written approval prior to beginning data collection. Student signature: Sally Researcher Instructor signature: Albert Einstein Program approval signature: Date: 8/15/12 Date: 8/15/12 Date: THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 11 Sample Research Review Application for a project with human subjects and using a web-based survey: RESEARCH REVIEW APPLICATION FOR MSA 699/699 AND EDU 776 CAPSTONE COURSE PROJECT Project title: Generational Differences at XYZ Corporation Student name: Sally Researcher Student ID#: 25689 E-mail address: resea1sl@cmich.edu Work phone: 989-774-0000 Home phone: 989-772-0000 Concentration: MSA-Human Resources Administration Instructor’s name: Dr. Albert Einstein Instructor e-mail: einst1aa@cmich.edu Course: MSA 699: EPN: 22120666 Program center: Main campus/Mt. Pleasant □ Do you intend to use human subjects or human subjects data in your project? Yes X No Do you intend to publish your project or present project results outside of your organization? Yes No X If you answered “yes” on both questions, you are required to complete CITI training and seek approval through CMU’s Institutional Review Board (IRB). The IRB process requires registration in IRBNet and submission of your application materials and supporting documents through IRBNet. Please consult with your instructor and the appropriate program office for assistance. If you answered “no” to one or both questions, you may use this form for your research review. Read the following directions: Non-human subject research Human subjects research In the box below describe the purpose of your research, describe the data you plan to use, and specify the sources of your data (URL, organizational source, etc.) Required attachments: Permission letter on the organization’s letterhead if the data is not available to the general public. In the box below describe the purpose of your research; specify the source of your subject pool, the number of subjects, and the selection criteria. Specify your relationship to the subjects (co-worker, supervisor, work in same organization, etc.). Describe your research methodology. Required attachments: Copy of survey or interview questions, cover letter or consent form, permission letter on the organization’s letterhead if the subject pool is not selected from a public source such as a phone directory or web page. This study examines the effect of generational differences at XYZ Corporation. All 450 employees will be invited to take an anonymous, online 10-question survey. The population includes approximately 300 women and 150 men. Approximately 125 subjects fall into the Baby Boomers age range, approximately 200 subjects fall into the Gen X age range, and approximately 125 subjects fall into the Gen Y age range. The researcher will not ask any questions concerning ethnicity or health status. The consent document with a link to the online survey will be distributed through the organization’s e-mail system. The researcher supervises some of the potential subjects and this will be noted in the consent document. The data collected will provide useful information regarding worker attitudes generational differences at XYZ Corporation. The benefits to the study are that the participants will be assisting researchers in learning about how generations differ in the workplace. This will ultimately help human resources professionals better meet the needs of all employees. The researcher will compile the data and draw some conclusions which will be available to all participants as well as to the organization’s training and development department. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 12 Please check all that apply: X My project is work-related X My project is related to my concentration My project is not related to my work or to my concentration. Please provide a rationale for a project that is not work-related or concentration-related: Directions: Type in your name as verification/approval of the information presented in this application. Your signature also confirms your commitment to appropriate research ethics while conducting this research: Submit this form and applicable attachments to your instructor. Please wait for written approval prior to beginning data collection. Student signature: Sally Researcher Instructor signature: Albert Einstein Program approval signature: Date: 8/15/12 Date: 8/15/12 Date: Routing: Student, Instructor, Program Office, Notification to Student/Instructor, Document Imaging/SLCM Coding Please see the following pages for sample attachments for a project with human subjects and using a web-based survey: 1. Sample Consent form or sample survey cover letter (either is appropriate) 2. Sample survey 3. Sample permission letter THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 13 Study Title: Generational Differences at XYZ Corporation Investigator: Sally Researcher, MSA Program, resea1sl@cmich.edu Faculty Monitor: Dr. Albert Einstein, MSA Program, einst1aa@cmich.edu Introductory Statement My name is Sally Researcher and I am a graduate student at Central Michigan University. As part of my research, I am examining the effect of generational differences at XYZ Corporation. All employees are receiving this survey invitation. Because you are an employee of XYZ Corporation, I am inviting you to participate in this research study by completing an online survey. The data collected will provide useful information regarding employee attitudes about generational differences at XYZ Corporation. If you would like a summary copy of this study please send an email to me at resea1sl@cmich.edu (it is not necessary to complete the survey in order to receive a copy of the results). Completion of the online survey will indicate your willingness to participate in this study. What is the purpose of this study? The purpose of this study is to gather data about the differences between generations in the workplace so that professionals in human resources can better understand how to meet the needs of all employees. What will I do in this study? If you consent to take this study, you will open the link to an online 10-question survey which is found at the end of this document. This survey is available to all of the XYZ Corporation’s 450 employees. All answers will be anonymous because no names or job titles are asked for in the survey. Surveys will be completed and submitted online through the link at the end of this document. The researcher will compile the data and draw some conclusions which will be available to all participants. How long will it take me to do this? This survey will likely take you about 15-20 minutes to complete. It can be taken any time until the survey deadline of September 15, 2010 at midnight. There is no advance preparation needed. Are there any risks of participating in the study? Although the researcher supervises or works with some of the participants, this survey will in no way impact your position with the company as I will have no way of knowing who participated and who did not. Participants are assured that their responses are anonymous. Participation is voluntary and opting to participate or not will have no effect on your job or position with XYZ Corporation. For those who participate, no risk or discomfort is anticipated. What are the benefits of participating in the study? The benefits to participating in the study are that the participants will be assisting researchers in THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 14 learning about how generations differ in the workplace. This will ultimately help human resources professionals better meet the needs of all employees. Will anyone know what I do or say in this study (Confidentiality)? All surveys are anonymous. I will see each survey, but will not be able to identify who completed it. The project will be shared with my faculty monitor. Data will be compiled and a copy of this study will be provided to the training and development department at XYZ Corporation. Will I receive any compensation for participation? There is no compensation or fee to be paid to any participant in this study. Participation is voluntary. Is there a different way for me to receive this compensation or the benefits of this study? No; there is no compensation for participating. Who can I contact for information about this study? For more information about the study, you can contact the researcher, Sally Researcher with the following contact information: Sally Researcher, (989) 774-0000 or by e-mail at resea1sl@cmich.edu or, you may e-mail by project advisor at einst1aa@cmich.edu Please not that if you are not satisfied with the manner in which this study is being conducted, you may report (anonymously if you so choose) any complaints to the MSA Program by calling 989-774-6525 or addressing a letter to the MSA Program, Rowe 222, Central Michigan University, Mt. Pleasant, MI 48859. Additional Information You are free to refuse to participate in this research project or to withdraw your consent and discontinue participation in the project at any time without penalty or loss of benefits to which you are otherwise entitled. Your participation will not affect your relationship with the institution(s) involved in this research project. Clicking on the survey link below implies my consent to participate in this research. This copy of the form is for me to keep for my records. CLICK THIS LINK TO BEGIN THE SURVEY: www.onlinesurvey.com/xyzgeneration/ Thank you for your participation! THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 15 Date Dear Participant: My name is Sally Researcher and I am a graduate student at Central Michigan University. For my final project, I am examining the effect of generational differences at XYZ Corporation. Because you are a fellow employee, I am inviting you to participate in this research study by completing the attached survey. The following questionnaire will require approximately 15-20 minutes to complete. There is no compensation for responding nor is there any known risk. In order to ensure that all information will remain confidential, please do not include your name. Copies of the project will be provided to my Central Michigan University instructor and to the training and development department at XYZ Corporation. If you choose to participate in this project, please answer all questions as honestly as possible and return the completed questionnaires promptly by clicking on the survey link found at the end of this letter. Participation is strictly voluntary and you may refuse to participate at any time. Although the researcher supervises or works with some of the participants, this survey will in no way impact your position with the company as I will have no way of knowing who participated and who did not. Your responses are anonymous. Participation is voluntary and opting to participate or not will have no effect on your job or position with XYZ Corporation. For those who participate, no risk or discomfort is anticipated. Thank you for taking the time to assist me in my educational endeavors. The data collected will provide useful information regarding employee attitudes about generational differences at XYZ Corporation. If you require additional information or have questions, please contact me at the number listed below. Please feel free to e-mail me if you would like a summary copy of the study. Please not that if you are not satisfied with the manner in which this study is being conducted, you may report (anonymously if you so choose) any complaints to the MSA Program by calling 989-774-6525 or addressing a letter to the MSA Program, Rowe 222, Central Michigan University, Mt. Pleasant, MI 48859. Sincerely, Sally Researcher, (989) 774-000 or resea1sl@cmich.edu Faculty Monitor: Dr. Albert Einstein, einst1aa@cmich.edu CLICK THIS LINK TO BEGIN THE SURVEY: www.onlinesurvey.com/xyzgeneration/ Thanks for your participation. Note to MSA 699 students: You may choose either the consent form or the survey cover letter. Both are not needed for a survey that is returned anonymously. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 16 Generational Differences at XYZ Corporation: Survey Instructions: Do NOT include your name on this survey. Participation is voluntary. Please answer the questions below by clicking on the best answer. 1. 2. 3. 4. 5. Please select the years in which you were born: o 1940-1949 o 1950-1959 o 1960-1969 o 1970-1979 o 1980-1989 o 1990-1999 o Prefer not to answer Please select your gender o Male o Female o Prefer not to answer For the majority of the time, do you prefer to work alone or with others? o By myself o In a small group (2-3 people) o In a group or team (3-10 people) o Other (please explain): ______________________________________________________ o Prefer not to answer For the majority of the time, do you prefer to work on one task or many tasks at a time? o On one task at a time o Some tasks at one time (2-5) o Many tasks at one time (6+) o Prefer not to answer How long do you intend to stay in your current position at this company? o 0-6 months o 6 months to 1 year o 1-3 years o 3-5 years o 5-10 years o Until I retire o Other (please explain): ______________________________________________________ o Prefer not to answer THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 17 6. 7. 8. Which generations do you find are easiest for you to relate to in this work environment? o People who are younger than me o People who are generally the same age as me o People who are older than me o There is no difference o Other (please explain): ______________________________________________________ o Prefer not to answer How enthusiastic are you about using new or emerging technology in the workplace? o Very excited by new technology and use it as much as possible o Like technology and willing to use it frequently o No opinion about technology and use it as needed o Hate using technology and use it as little as possible o Other (please explain): ______________________________________________________ o Prefer not to answer Please rank the following items in order of importance to you, with #1 being the MOST important to you and #4 being the LEAST important to you. Feel free to add up to two items (if you add items, your rating scale will have more items). _____ Work ______ Family _____ Social Life ______ Recreation _____ Other (please explain): ________________________________________________ _____ Other (please explain): ________________________________________________ Please answer the following questions in the space provided. 9. How would you describe the work habits of people in your generation? Please list characteristics, behaviors, values, beliefs, or any other items you feel describe your generation. 10. What are some of the challenges and advantages you see with working with people of a different generation? Please be specific. If you prefer not to answer, simply skip this question and go to the next. When you are satisfied with your answers, please submit your anonymous survey by clicking on the button below. SUBMIT Thank you for your participation THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 18 XYZ CORPORATION 2326 Pennsylvania Blvd. Mt. Pleasant, MI 48858 989-775-6565 http://www.xyzcorp.com Date: August 6, 2012 Sally Researcher 4444 S. Madison Mt. Pleasant, MI 48858 Dear Ms. Researcher: I have reviewed your request to conduct a research project involving the XYZ Corporation and the survey material that will be used. I feel that this project will be beneficial to the XYZ Corporation as well as the project’s participants. You have my permission to use the XYZ Corporation employees as the subject pool for this project. Contact Mary Richards for the list of e-mail addresses. If you have any questions regarding this letter of approval, please give me a call at 989-775-6523. Sincerely, Richie Rich CEO, XYZ Corporation THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 19 Sample project descriptions for the Research Review Application form: A project using company data: LMP Widget Corporation is the third largest widget producer in the United States. The researcher will analyze production rates, production costs, and order fulfillment in order to determine the feasibility of adding a third production shift. The researcher will use internal production logs, accounting data, and purchase order information in this analysis. This project and the use of these company data has been approved by the CFO of LMP Widget Corporation. A signed permission letter on company letterhead is included with this application. A project using a web-based survey and subjects selected through an Internet search: The purpose of this study is to examine healthcare and learning institutions' strategic initiatives geared towards reducing the current and pending physician shortages in the rural areas of Kansas. The information would be analyzed to determine which strategic plan is the most conducive in addressing the physician situation in the area, state and nation. Alternative strategic plans will be developed. A web-based survey will be made available to approximately 20 healthcare institutions in the selected rural areas and to medical schools in the state. Targeted institutions for the survey were selected through an Internet search. Note: Along with the Research Review Application form, the student researcher will also send a cover letter or consent form and a copy of the survey to the instructor. A project using summarized company survey data: The Pink Roof Inn has accumulated three years of customer satisfaction survey data that has never been analyzed. The purpose of this project is to analyze this survey data and present recommendations to management in the areas of facility and staff training improvements. The survey questions included the customer’s overall hotel experience as well as specific questions about the room amenities, the restaurant facilities, front desk staff, cleaning staff, wait staff, and suggestions for improvements. The survey data will be provided to the researcher in a summarized format. A signed permission letter (on hotel letterhead) is included with this application. A project using factual organizational data: The purpose of this study is to analyze the feasibility of replacing Blackboard with a free, opensource learning management system at Outer Limits University in order to preserve financial resources. Data analyzed for this project will include: A list of plugins and their functionality for OLU's existing Blackboard system The server configuration for OLU's existing Blackboard system THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 20 Usage and maximum load statistics for OLU’s existing Blackboard system OLU’s licensing and support costs associated with Blackboard The department and staff structure currently in place to support Blackboard A signed permission letter from the VP of Information Technology at OLU is included with this application. Staff in the areas of academic computing, Blackboard administration, and purchasing will supply information about Blackboard plugins and functionality, server configuration, and load statistics, details on Blackboard's licensing and support costs, and the support structure for Blackboard. A feasibility study: The purpose of this project is to develop a feasibility study for a gift shop in the local art museum. Adding a gift shop would involve converting existing office space. Data about conversion costs and building permits will be obtained through calls to local contractors and the appropriate city government offices. The researcher will conduct Internet searches to identify other museums of a similar size with gift shops. General operations information will also be available from the Internet searches. More specific information such as staffing levels, inventory levels and costs, and inventory sources will be obtained through phone calls to the various gift shops. All questions will be factual in nature. A project using a survey that is returned through interoffice mail: In January 20XX, the ABC Corporation laid off approximately 10% of their workforce. The increased workload plus feelings of insecurity in the remaining employees contributed to low morale and descreased prductivity. The purpose of this project is to examine the attitudes, morale level, and perceptions of employees who have experienced this period of downsizing in the corporation. The objective is to make recommendations to management to improve morale and make positive changes during the period of restructuring. The researcher will invite every 3rd name form the employee roster to participate in the anonymous 12-question survey. Surveys will be returned through interoffice mail. The researcher is a supervisor of 20 employees. Those 20 employees will not be included in the subject pool. There are approximately 600 employees and the researcher estimates that there will be approximately 115 women and 85 men in the subject pool after names are selected from the employee roster. The only demographic question is length of employment. It is estimated that 50 will have been employed 0-5 years, 75 for 6-10 years, 40 for 11-15 years, and 35 for 16+ years. Note: Along with the Research Review Application form, the student researcher will also send a cover letter or consent form, a copy of the survey, and a signed permission letter (on corporation letterhead) to the instructor. A project using data that is available to the general public: The purpose of study is to determine if the Pay for Performance Program has improved customer service within the Postal Service. The data to be analyzed will include First-Class Mail on-time delivery scores; mail volumes; total factor productivity; complement; opertating THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 21 expenses; pay for performance program. Sources for the data are the following: USPS Annual Reports for 2003, 2006 & 2009 GAO Report 08-996 OIG report NO-AR-09-003 www.usps.com A project using a personal interview: The Second Bank of Atlanta adopted a new employee performance evaluation system one year ago. Reviews are now done semiannually and involve both self-review and peer review. Staff members also evaluate the supervisors. Interviews will be conducted with a sampling of staff and supervisors to assess the impact of changing the performance evaluation system. The study will help to determine if the new system has opened up communication among staff or do staff think the new system is less effective than the previous system. There are approximately 85 employees at the bank. The researcher intends to interview 5-6 supervisors and 8-10 staff employees. The only demographic that will be reported is whether the subject is a supervisor or an employee. There are 23 supervisors and 65 staff employees. Theresearcher will post a notice in the breakroom requesting volunteers. If the list of volunteers does not include enough supervisors or enough staff, then the researcher will call employees and ask if they would be willing to be an interview subject. Employees selected for phone calls will be selected from the employee roster supplied by the personnel department. Every 4th name will be contacted. Staff in the investigator’s department will not be included. Interviews will take place in the researcher’s office and will be taped if the subject gives permission to do so. The researcher will make transcriptions (no names recorded) and the tapes will be destroyed after transcription. Note: Along with the Research Review Application form, the student researcher will also send a consent form, a copy of the interview questions, and a signed permission letter (on bank letterhead) to the instructor. Suggested text for permission letters (be sure that the letter is signed and on letterhead): Example 1: I have reviewed your request to conduct a research project involving the ABC Corporation and the survey material that will be used. I feel that this project will be beneficial to the ABC Corporation as well as the project’s participants. You have my permission to use the ABC Corporation employees as the subject pool for this project. If you have any questions regarding this letter of approval, please give me a call. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 22 (Under the signature, please include the name and title of the person granting permission. Also include a contact phone number here or in the body of the letter.) Example 2: I have reviewed your request to use the organization’s survey data in your graduate student project. Permission is granted to use this data in your project and the survey data will be provided to you in a summarized format. As we discussed, please refer to the organization as ABC Corporation in your project. When available, please send me a copy of your finished project. If you have any questions regarding this letter of approval, please give me a call at XXXXXX-XXXX. (Under the signature, please include the name and title of the person granting permission.) Example 3: I have reviewed your proposed project and agree that it would be beneficial to the corporation. You have my permission to use the production logs, staffing reports, and the purchase order system to gather your data. Please show this permission letter to the relevant units. If you have any questions regarding this letter of approval, please give me a call at XXXXXX-XXXX. (Under the signature, please include the name and title of the person granting permission.) Example 4: I have reviewed your proposed survey and you may distribute the survey and cover letter in the staff mailboxes. The surveys should be completed during breaks or over the lunch hour. Please give me a copy of your project results. If you have any questions regarding this letter of approval, please give me a call. (Under the signature, please include the name and title of the person granting permission. Also include a contact phone number here or in the body of the letter.) THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 23 FAQs 1. What will my instructor and the MSA office look for in my Research Review Application materials? In addition to the completeness of your research review application materials, grammar and spelling counts. The fillable Research Review Application form does not allow you to use any spell-checking functions, so be sure to read through for spelling issues and readability. Check the spelling in consent forms and surveys prior to sending the documents to your instructor. This package of documents is a reflection of you and your professionalism. In addition, in consent documents, you are a representative of Central Michigan University. Take time with your RRA materials. Be as detailed and specific as possible. 2. Are there still IRB categories? Under the new Research Review Application process, there are no IRB categories. Under the new Research Review Application process, we will categorize projects as “non-human subjects” or “human subjects research.” a. Projects involving data that is not human subjects data, such as financial information or public policies qualifies for the non-human research determination. Survey data may qualify for this category if it already comes to the researcher as summarized and de-identified data. If the source of the data is not available to the general public, a permission letter (on letterhead) should be included in your Research Review Application materials. b. Projects involving surveys, interviews, or records studies will fall into the human subjects research category. A copy of the survey/interview questions, a consent document and a permission letter (on letterhead) should accompany your Research Review Application. Students who need to seek IRB approval should access “The MSA Student’s Guide to the IRBNet Process.” 3. Use of e-mail in distributing and collecting surveys Unfortunately, the use of e-mail to distribute and collect surveys poses a number of issues in terms of subject anonymity. Even if the researcher chooses to delete the emails which contain identifying information, there is still the possibility that the emails still exist on hard drives or, in networked systems, , are backed up by the server. As students you have access to many free web-based survey services. You are strongly encouraged to use these services. See also item 20. 4. Hospital IRBs and other institutional IRBs Although you may not be required to go through CMU’s Institutional Review Board process, you may be required to seek approval from your hospital’s or other THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 24 institutions’ IRB. The IRB approval, on letterhead, from the other institution should be included with your Research Review Application materials. 5. Secondary data and records studies Secondary data encompasses many types of data, such as financial data, public records, and record reviews (student files, medical files, etc.). In general, data that comes to you in a summarized and/or de-identified format is considered non-human subject research. Projects where you, the researcher, have access to raw data either in the form of survey responses, student files, employee files, etc. fall into the human subjects research category. In the Research Review Application, be sure to specify what data is being recorded for purposes of research and be sure that names or other identifying information is not recorded. A data recording sheet should be included with your Research Review Application materials along with a signed permission letter stating that you may use the data in your project. Even without the IRB requirement, we still need to think about accidentally disclosing data about individuals. There is little risk to subjects if the information is recorded in such a manner that subjects cannot be identified directly or through identifiers linked to subjects, and consequently there is no possibility of an accidental breach of confidentiality (e.g., even if the researcher lost the data in the airport, there would be no way to link the information to individual persons). So, a key issue is not whether the researcher can see the names in the files, but whether the information is recorded for research purposes without identifiers or codes that link data to names. An additional issue is whether using the records for research purposes might be viewed as an impermissible invasion of subject privacy. If the records were created for non-research purposes (such as medical treatment or diagnosis) and the subjects had high expectation that the records would be kept private, even more care must be given to maintaining confidentiality...Linking names to codes is generally not appropriate. HIPAA regulations must be respected and given priority over any research considerations. 6. Telephone scripts If a student plans to conduct a telephone survey, the “telephone survey/informal interview template” should be used. The template for this form is found at http://www.cmich.edu/academics/graduate_studies/GSMasterofScienceinAdministrati on/GSTheDepartment/Pages/Research_Review.aspx 7. Permission letters Approvals to conduct surveys or interviews should be on company or institution letterhead. The letter must be signed. Typed signatures are not acceptable. If the THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 25 name of the person giving authorization is not clear, you may be required to supply the name. A contact phone number should be included on the letter. E-mail permission letters may be accepted if sent from the organization’s e-mail system. Requesting a permission letter may be a lengthy process, for example, if you need review by the legal department or consent from the union. If you are not able to scan your permission letter and add the letter to your Research Review Application materials, please fax a copy of the permission letter to the MSA office (989-7742575). 8. Public Property Remember that public property is just that, property belonging to the city or state. However, local ordinances may vary and it may be prudent to obtain a permission letter. Surveys conducted in supermarket parking lots, in malls, or in front of a business location require letters of permission. 9. Why is it important to state the number of subjects in my project? Your instructor and the MSA office reviewer need this information to assess one of two things. First is the subject population so small that subject anonymity cannot be protected. Second, if demographic questions are used, can any subject be identified through combined responses to those questions? Ask yourself why you need the demographic information. If you do not plan to use this information in your analysis, then delete the questions. If you wish to merely describe the subject population, there may be other sources, such as the HR department, for that information. Keep in mind that with each demographic question, you are subdividing the sample. For example, your survey has two demographic questions, gender and level of education. In the subject population, there is only one male with a doctorate. If that subject participates in the study, he will not be anonymous. 10. Do I still need to identify potential risk? The requirement for sound research methodology and appropriate research ethics should always be part of your research project. So, it is important to provide adequate notice to subjects on any potential risks. It is possible for a project to have some risk and be approved if the risk is clearly identified, if subjects are informed of the risk, if the benefits outweigh the risk, and if the investigator has made provisions to minimize the risk. According to the Institutional Review Board and still applicable to the Research Review Application process, “a risk is a potential harm (injury) associated with the research that a reasonable person, in what the investigator knows or should know to be the subject’s position, would be likely to consider significant in deciding whether or not to participate in the research.” Risk can be more than a breach of confidentiality or the possibility of subject identification. Additionally, risk may involve sociological issues, psychological issues, and so on. The five major types of risk are physical, psychological, social, legal, and economic. Many projects contain a mixture of risks. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 26 11. When do I use a consent form/cover letter for anonymous surveys and when do I use an adult consent form? A consent form for anonymous surveys or a survey cover letter is used whenever the project involves a survey which can be returned anonymously by subjects. Anonymous return is achieved by using U.S. mail, interoffice mail, or a secured drop box. An adult consent form is used in the following types of projects: a. personal interviews are conducted and questions are non-programmatic b. children are involved in the project (Child assent and parental consent are also needed. There are age-specific child assent forms. The adult consent form is used for parents) c. subjects are being observed and there is no expectation that their behavior is public 12 What is the difference between programmatic questions and non-programmatic questions? Programmatic questions are factual in nature. The interview subject is being asked about things, not opinions. For example, “how many employees work here?” is programmatic in nature, while “do you feel that staffing levels are adequate for your store?” is not. Non-programmatic questions ask the subject to express feelings, give an opinion, or make a judgment. 13. What do I say in my consent form/cover letter for anonymous surveys or adult consent form if I am a supervisor? If you supervise any or all of your subjects, you must reduce the possibility of any perception of coercion on the part of potential subjects. In the consent form for anonymous surveys, you can add the following: “Although I supervise some (or all) of you, your decision to participate or not to participate in this project will not jeopardize your position in any way because I will have no way of knowing who participated and who did not participate.” In the consent form, you must acknowledge that you supervise the interviewee and assure the research subject that they may stop at any time or decide not to participate in the interview without repercussion and without putting their jobs in jeopardy. 14. How do I address risk in my consent materials? If the project involves some potential risk to subjects, for example, recalling episodes of workplace violence, you can add the following to the consent for anonymous surveys or consent form: “Some of the questions included on this survey (or in this interview) may make you feel uncomfortable (Note: this is where you can specify the risk in more detail). Please answer only the questions you are comfortable in answering. You may stop at any time. If you experience any emotional distress because of this project, please call (XXX) XXX-XXXX which is a contact number for support services (specify the name of the service).” Identify any potential risks as you describe your research methodology on the Research Review Application form. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 27 15. Public lists When students get names, addresses, and e-mail addresses from a public list, the public list must be one that is accessible to the general public. For example, an online membership directory of an organization that requires a member/user ID and password is not considered to be a public list. Whenever a list is open to members only and not available to the public, CMU requires signed permission from the list owner (on letterhead). 16. Tips for consent documents and cover letters It is important that the consent documents be consistent with the information found in the Research Review Application and permission letter. For example, if there is a statement in the application form that project results will be shared with management, this information should be in the survey cover letter. If the information in the application indicates that the survey will be returned by interoffice mail, the survey cover letter should contain this instruction. In addition, if the permission letter indicates that the survey should be completed on personal time, this stipulation should be included in the consent document. If you use the consent form format, be sure to write the consent forms as an informational document for the subjects. All of the “I” and “me” references are to the subject, not to the researcher. 17. Anonymity vs. confidentiality Anonymity can be promised when the researcher not only provides a method of returning a survey that is anonymous and also does not collect any data that could identify individual subjects to the researcher or readers of the final project. Examples of methods for anonymous return are a drop box in a central location, through the mail, through a web-based survey (with no IP addresses collected), through interoffice mail, and so forth. On the other hand, if the researcher’s data contains identifiers, names, titles, specific demographic data, the researcher must discuss in the consent form and RRA application how that data will be kept safe. What are the safeguards that the researcher will use to keep the data confidential? How is the data stored? Will it be destroyed? Will signed consent forms be separated from interview notes? Where will interview notes be stored? How will the subjects be referred to in the project? These are among the many issues involved in providing confidentiality. 18. Do I need both a consent form and a survey cover letter? No, in general, only one consent document is necessary. The consent form is a more formal document with its defined sections. The survey cover letter is less formal and allows for a friendlier tone. Either is appropriate. 19. How do I find a subject pool if I am not employed? There are many possible sources for your subject pool. Keeping in mind that your project should be concentration related and administrative in focus, there are many THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 28 appropriate sources. Here are some suggestions: a. A general survey could be distributed to a church congregation. A permission letter from the minister or church board is required. In addition, it is prudent to add an age disclaimer to the survey cover letter. b. Professional organizations: If you are a member of a professional organization, you may be able to get permission to survey the organization’s membership. A permission letter from the organization’s leadership is required. c. Internet searches: Many companies include contact information on the company web site. Using a search engine, you can find the company’s web site and the contact information. You may also find public lists (no login ID or password needed) that have been developed by someone else. d. A local organization may have a pending project. Your volunteer assistance with that project may provide you with a suitable MSA 699 project and access to a subject pool. A permission letter from the organization is required. 20. Should I use an online survey? There are many benefits to using an online survey. An online survey can be inexpensive and efficient as well as providing anonymity to your subjects. By inserting the term “free online surveys” into a search engine, you will be able to find a variety of companies offering a free survey service. Many companies have a student option which is generally limited by the number of questions and subjects. Depending on the price, you may also be able to use a paid survey panel as your subject pool. If you go with this option, clearly articulate this in your RRA form. There are two ways to manage online surveys and your cover letter. One method is placing a link to the survey in the survey cover letter. The survey cover letter text is then e-mailed to the prospective subjects. For example, “Please click the following link to access this web-based survey” The other option is to place the survey link in the invitation e-mail and have the survey cover letter be the first page on the online survey. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 29 MSA 699 PROCEDURES This section discusses the “housekeeping” issues related to the MSA 699 course, such as registration, payment, forms, and the various faculty members involved in the course. As always, if you have questions, contact the program administrator at your center or the staff member responsible for your cohort. Some off campus procedures may not apply to on campus students. On campus students, please check with your MSA 699 monitor for clarification. REGISTRATION AND PAYMENT PROCEDURES You will register for MSA 699 through the CMU Portal using the registration procedures that you have used for other courses. 1. Register online using the CMU Portal at Central Link (https://centrallink.cmich.edu/Pages/default.aspx) . You will need an active CMU Global ID to register. 2. Off Campus Students: For international students call (800) 664-2681 or (980) 774-7827. 3. Off Campus Students: If you are unable to register online contact your local CMU program administrator (e-mail, mail, phone or walk-in). For Off Campus Students: If you have a hold on your account, please call the toll-free number and speak to an operator. Operators are available at (1-800-664-2681) Monday through Friday from 7:15 am to 5 pm. If you have difficulty getting registered, please contact your program administrator. Registration Dates Registration dates for MSA 699 are published in the program center’s course schedule, online at http://www.cel.cmich.edu/schedules/, or in your cohort schedule. For on campus students, please check with the MSA department office or check the MSA department web site or the Registrar’s web site. Course Dates Because the MSA 699 project typically requires more time than other CMU classes you have completed, the course dates for MSA 699 are longer than other CMU classes. MSA 699 is only offered three times a year, so please plan accordingly. The dates for the workshop are available from your program center, online, or in your cohort schedule. Prerequisites To register for MSA 699, you must meet the prerequisites as listed in the Bulletin. The prerequisites for MSA 699 are twenty-four hours of graduate credit, including MSA 600, MSA 602, and MSA 603. If you have questions about the prerequisites, you may wish to contact your academic adviser. The current registration system allows you to pre-register for MSA 699 in the next semester if you have completed the prerequisites or will complete the prerequisites in the THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 30 preceding semester. You will be administratively dropped from MSA 699 if a “C-“ or “E” grade is earned in a prerequisite course (MSA 600, MSA 602 or MSA 634 or 635, and MSA 640 or MSA 600, MSA 602, and MSA 603). You may also be dropped if you have an incomplete grade in a prerequisite course and will not complete the course requirements before MSA 699 starts. Texts  The Student Guide to the MSA Capstone Project is required for MSA 699 and is only available online at http://www.cmich.edu/academics/graduate_studies/GSMasterofScienceinAdministration/ GSTheDepartment/Pages/Research_Review.aspx  APA Style Manual (current edition) Your instructor may require additional resources When you register for MSA 699, you will need to access the following documents (On campus students should check with the course instructor): 1. Application for Approval of MSA 699: Integrative Analysis of Administration Project form (http://global.cmich.edu/student/forms/default.aspx#irb) 2. MSA 699 Project Grading/Evaluation form (http://global.cmich.edu/student/forms/default.aspx#irb or http://www.cmich.edu/academics/graduate_studies/GSMasterofScienceinAdministra tion/GSTheDepartment/Pages/Research_Review.aspx) 3. Course outline (includes name, address and telephone number of instructor/monitor) (http://global.cmich.edu/courses/search.aspx) 4. Application for graduation (check for application deadlines) (http://global.cmich.edu/student/graduation/default.aspx) THE COURSE WORKSHOP AND YOUR PROJECT MONITOR You are required to attend the twenty-four (24) classroom hours for MSA 699. Dates, times and locations are listed in the online schedule and the course schedule booklet. The instructor for the workshop will also be your MSA 699 project monitor and the instructor of record. The workshop is designed to assist you in finalizing your project proposal. Your MSA 699 project proposal must be approved by the MSA 699 monitor before you begin the research, the data collection and the writing of your MSA 699 project. (Note: No data can be collected until you receive notification of either Research Review Application approval or IRB approval. See the MSA Student’s Guide to IRBNet for information on the IRBNet submission process.) See the following section for directions on submitting your proposal. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 31 Your MSA 699 Project Monitor The MSA 699 project monitor is the instructor who assigns the grade of record for your MSA 699 project.  Project Proposal: The MSA 699 project monitor will give the final approval of your project proposal. When submitting your final project proposal, you will need to complete and attach the Application for Approval of MSA 699: Integrative Analysis of Administration Project. The application includes the project title and a brief project description. If the proposal is approved, the form will be signed by your monitor. The student copy of the Application for Approval will be returned to you for your records.  Research Review Application process: complete the Research Review Application as covered in the earlier portion of this document.  If you need to seek IRB approval, complete CITI training and use IRBNet for your application process. IRBNet IRB submission: The MSA 699 project monitor will be listed as the co-investigator when you set up your IRB application in IRBNet (see the MSA Student’s Guide to IRBNet for more information). After you have shared your study, the monitor will review your materials, sign the study, and share it with Kim Gribben and Carol Kross in the MSA office. After review and receipt of revisions, if needed, Kim will submit the IRB application on your behalf.  MSA 699 Project: The MSA 699 project monitor will work with you on an individual basis to complete your MSA 699 project. Our goal is that the final evaluation will be done electronically. When you and your monitor agree that the project is ready for final evaluation, you will need to do the following: 1. Upload your project into the course Blackboard shell. Your instructor will have provided an area to post your project. There may be separate sections for submitting a draft of the project and for submitting the final version. 2. Your monitor may also require you to submit your project through Safe Assign. SafeAssign is a plagiarism detection and prevention tool which is included within Blackboard. 3. Your instructor may ask that you complete the personal information sections of the MSA 699 grading/evaluation form. We are still in a transition period related to electronic review of the MSA 699 projects. Follow the instructions provided by your MSA 699 monitor. Once received, the monitor will grade the project. The monitor will complete his or her section of the MSA 699 Grading/Assessment form found at http://www.cmich.edu/academics/graduate_studies/GSMasterofScienceinAdministration/GST heDepartment/Pages/Research_Review.aspx. Important Notes: 1). Our expectation is that you will complete the MSA 699 project within one semester. That is why the course is scheduled early in the semester. Your THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 32 monitor’s MSA 699 syllabus should provide guidance on the requirements to receive a grade of incomplete in the course. Generally, approval of your research proposal and starting either the Research Review Application or IRB process is sufficient. However, check with your MSA 699 project monitor on this issue. 2). You are responsible for any costs related to completing your project. This includes photocopying, binding, and/or postage used to mail materials to your monitor. The Project Reviewer Once your monitor grades your project, it is sent to the appropriate office who will assign it to a second reader. The second reader, the reviewer, will read and grade your completed project. The reviewer is a CMU adjunct faculty member who is either a current MSA 699 monitor or a former MSA 699 monitor. The reviewer will assign a grade and place it on the MSA 699 Project Evaluation. Reviewers are assigned by the appropriate office and are former or current MSA 699 monitors. YOUR FINAL GRADE Usually the grade assigned by the monitor is your final grade. If the second review has been completed, letter grades will be submitted online shortly after the ending date of the MSA 699 course. In instances where a full two-letter difference separates the grades of the monitor and reviewer (e.g. A and C) or where one of the evaluators assigns a grade of C- or E, the MSA 699 project is sent to the MSA director on campus for evaluation by an on campus faculty reviewer. In this case, the grade assigned by the campus reviewer will be your final grade. You will receive a copy of the MSA 699 Project Evaluation and so that you know the grades assigned to your project. A copy of your project with comments will also be sent. If both the MSA 699 project monitor and the reviewer assign a failing grade (C- or E), no additional review will be undertaken. Grading/Assessment/Evaluation Rubric Effective spring 2012, MSA 699 instructors will use a grading, assessment, and evaluation rubric to determine your final grade. While the rubric is subject to change, the essentials of the rubric are presented here: Master of Science in Administration Capstone Evaluation (MSA 699) and Assessment Student Name Student ID number Concentration (select from drop-down menu) Drop down menu here for concentration Faculty Monitor’s name Project Title Semester/year for MSA 699 EPN for MSA 699 THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 33 Instructions: The monitor and reviewer will separately review the MSA 699 project and assign points per section based on the characteristics listed below. Compute the total points and insert the grade based on the grading scale at the bottom of the form. Dimension and Percentage Weight Points Earned Monitor Points Earned Reviewer Assessment (relationship to concentration) 10% (10 points) Select the matching concentration measures from drop down menu for the first two items Drop down menu here for concentration measures Drop down menu here for concentration measures Chapter 1, Definition of the Problem 10% (10 points) States the problem concisely and purpose of the research-with background information Makes connections to previous research Establishes the need to the field of study Describes limitations to the study Introduction: Problem Statement (Problem Formulation), Purpose of the Study, Research Objectives, Scope, Definition of Terms, Limitations/Delimitations, Appropriately defined hypothesis Chapter 2, Literature Review 15% (15 points) Sets out a context for the research Evolves in an organized progression Builds a sequence of ideas that convey a reasonable argument Utilizes and synthesizes current, relevant, and credible sources Summarize sources well/cited properly/mix of direct quotes and paraphrase Sources are sufficient in number to create the context for the problem and to demonstrate understanding of the problem/issue Supports the purpose and direction of the research project Chapter 3, Methodology - 10% (10 points) Detailed methods of data collection and analysis provided (if used, secondary data is appropriate and takes a fresh approach to the issue.) Identifies the population and selection procedures and explains why this sample was selected For a product, explains process for design and development specifications, including monitoring and evaluation of the product (if a product). Product suited the needs of the intended target population Includes Target Population, Sample Description, Required Resources, (Product Cost and Benefits Analysis if any) Variables are considered for testing and hypothesis Methodology is sufficient to adequately test and address the hypothesis Chapter 4, Data Analysis- 15% (15 points) Addresses and explains all the data presented. Interpret data Provides narrative to explain graphics Appropriate statistics used to present/analyze data Chapter 5, Summary, Conclusions, and Recommendations- 10% (10 points) Makes interpretations and recommendations based on the data provided THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 34 Integrates findings of the literature with findings of the study that relate to the research objectives Makes recommendation(s) to improve the finding of the study Draw or state conclusion(s) If appropriate, implements recommendation(s) References - 10% (10 points) Reflect current scholarship on the problem/issue as well as historical scholarship A minimum of 20 scholarly sources utilized within document All sources in text of paper are properly listed on the reference page(s) Writing/Formatting/Executive Summary - 20% (20 points) Executive summary is two pages or less and describes the entire study Demonstrates control of syntax and grammar coherence Paragraphs should be focused and connected with transitions Proofread for spelling, typing, punctuation The project included the preliminary and supplementary, pages required by the Student Guide to the MSA Capstone Project: Title page, Appendix, List of References. Recommended: Minimum of 30 pages excluding tables, figures, and appendices and 20 References References in text and on reference page follow current APA Style/proper citation Tables and figures are labeled and numbered according to the latest edition of the APA Style Manual Title page, executive summary, table of contents, list of tables and list of figures, headings, margins, and spacing conform to the latest edition of the APA Style Manual All requirements in MSA Capstone Guide are followed including research approval Writing reflects graduate level work Final Score Scale is as follows: A = 94-100 A- = 90-93 B+ = 87-89 B= 84-86 B- = 80-83 C+ = 77-79 C= 74-76 C- = 70-73 E= Below 70 Monitor’s Signature (type name) Date Reviewer’s Signature (type name) Date This is the list of Routing: Monitor>Program Ctr>Reviewer>Program Ctr> MSA office/Original: concentration measures MSA office Copy: Monitor, Student, Reviewer AA--Understanding procurement contracts AA-- Maintain Supplier Relations and concentrations Acquisitions Administration General Administration GA--Evaluate organizational environment Health Services Administration GA--evaluate socio-economic systems Human Resources Administration HSA-Understanding roles of health administrators Information Resource Management HSA--Financial, legal, and planning skills International Administration HRA--Knowledge of human resources Leadership HRA--Evaluating labor issues Organizational Communication IRM--Managing information systems Public Administration IRM--Systems analysis and design Recreation & Park Administration IA--International business practices Sport Administration Vehicle Design & Manufacturing Administration IA--Evaluation of international economics Ldrshp--Understanding leadership styles Ldrshp--Principles of Leadership PA--Environments of Public Administration THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 35 Comments: PA--Analyzing public policy RPA--Theory, research and current practices RPA--Alternative courses of action SA--Principles of Sport Administration SA--Issues involved in sport facilities VDMA--Applications of production concepts VDMA--Industrial management principles The following is a representation of page 3 of the MSA 699 Evaluation/Assessment Rubric: CENTRAL MICHIGAN UNIVERSITY GLOBAL CAMPUS MSA 699 Project Evaluation The monitor’s grade is the final grade unless the reviewer’s was two grades or more different from the monitor’s. THE TOP PORTION OF THIS FORM MUST BE TYPED AND COMPLETELY FILLED OUT Student Name Street Address City Home Center of Student Advisor’s Name Project Title Center for MSA 699 State Zip Student No. Telephone No. (Work) ( ) Telephone No. (Home) ( ) Area of Concentration Monitor’s Name Semester/Year MSA 699 was taken EPN# of MSA 699 □ Please mark to verify that the RRA or IRB process has been completed. Every student must complete one of these processes in order to graduate. Do not grade project unless documentation of RRA or IRB approval is received Monitor should comment on the degree to which the student fulfilled the assignment and the quality of the content, the cope, the depth, and the format. Monitor’s Signature Date Grade Reviewer should comment on whether or not the project has fulfilled the requirements for MSA 699 Reviewer’s Signature Date THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Grade Page 36 INCOMPLETE GRADES An I grade will be assigned if you have not completed your MSA project by the last day of class and if you meet the criteria for an I grade listed on the MSA 699 syllabus or if your project is still in the second review process. If you are assigned an I, the MSA 699 project monitor will submit a Statement of Requirements for Removal of MSA 699 Incomplete form after posting grades online. On the form, the monitor lists a deadline for completion of the MSA 699 project. It is your responsibility to make arrangements with the monitor to complete the project. The length of time in which an I must be removed is six months from the start of your course. Extensions beyond six months must be approved by your instructor in consultation with the MSA office. Once you complete the project, the monitor will submit a Removal of Incomplete card that lists the new grade. Once the grade has been changed on your transcript, you will be notified of the grade change by CMU’s Registrar’s office. EXPIRATION OF RRA/IRB APRPOVALS Please note that Research Review Application approvals are good indefinitely. However, the assumption is that you will collect your data shortly after receiving approval. Keep in mind that the permission from your organization may not be good indefinitely. IRB approvals are good for one calendar year for projects in the “expedited,” or “full board review” categories. IRB approvals falling into the “exempt” and “non-human research determination” categories do not expire as long as the project protocol remains unchanged. Again, check with your MSA 699 project monitor on your project completion deadline. You must comply with the deadline set by your monitor. If you are required to repeat MSA 699, please consult with your monitor about your research approval. You may not need to reapply for approval if you have already collected your data and the data are still viable for use in your project. Ask your monitor to contact Kim Gribben in the MSA Office to confirm that you have already collected data and wish to use the previous RRA approval. Kim will then add a note to your student file to inform your graduation auditor that you do not need to seek RRA approval again. APPLYING FOR GRADUATION Many students apply for graduation at approximately the same time they register for MSA 699. Graduation deadlines and requirements are listed in your Bulletin. An application form is included in your Student Handbook, is available at the program center, and online at http://www.cel.cmich.edu/student/forms/default.html. On campus MSA students can access the graduation application at THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 37 http://www.cmich.edu/Graduate_Studies/New_and_Current_Students/Applications_and_Forms/ Applications_and_Academic_Forms.htm. . If you have questions about meeting graduation requirements, you should arrange for an appointment with your academic adviser and review your program plan. Remember the end of project report is a requirement for projects with “expedited” or “full board review” IRB approvals. ISOLATED STUDENTS MSA 699 is available online through Central Michigan University’s Global Campus. HOW IS MY PROJECT STORED? We are no longer maintaining permanent storage of MSA 699 projects. We strongly encourage you to keep an electronic copy of your MSA 699 project for your own records. Your MSA 699 monitor will provide instructions about uploading your final project into the course Blackboard shell. Your project may be selected by the MSA Director for examination as part of assessment activities. MSA 699 projects for main campus MSA students are scanned and maintained in the MSA office. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 38 LIBRARY SUPPORT On campus MSA students should visit Park Library on CMU’s campus or access library services found at http://library.cmich.edu. A variety of research guides are found at http://library.cmich.edu/subjectguides. Global Campus MSA Students While working on the MSA 699 project, a Global Campus Library Services librarian can help you by:  Identifying resources appropriate to your topic  Suggesting search terms and tips to used during your research  Answering questions related to the research and writing process  Working with you on your formal literature review  Providing answers to APA style questions The literature review for the MSA 699 project should be more extensive than any you have done for other courses. You will want to keep a log of your search, including steps that are not rewarding, to be able to document the process to your monitor and avoid repeating steps you have already completed. Information on how to complete a literature review can be found at http://libguides.ocls.cmich.edu/content.php?pid=27285&sid=304671. Hours (Eastern Time): Regular Semester Hours (EST) Reference Librarians Documents on Demand Sunday 1:00pm - 6:00pm EST 12:00pm - 9:00pm EST Monday - Wednesday 8:00am - 9:00pm EST 8:00am - 7:00pm EST Thursday & Friday 8:00am - 5:00pm EST 8:00am - 5:00pm EST Saturday After hours mailbox CLOSED Hours may change during university vacations and breaks. Check http://ocls.cmich.edu/hoursocls.htm for an up-to-date listing of hours. Research Resources The appropriate sources to use when doing your research are available online through the Global Campus Library Services Web site at http://ocls.cmich.edu. You can begin your research on your own or contact an GCLS librarian for assistance. THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 39 1. Articles Search the library’s research databases to find journal articles on your topic. Many articles will be available in full-text directly through the databases. You may also request full-text copies of any article through the library’s Documents on Demand office. Links to the databases listed below are available at http://libguides.ocls.cmich.edu/databases. Below is a sample of databases available in each subject area. Business & Management Topics: ABI-Inform Wilson Business Business Dateline Business Management EconLit General Business File ASAP Lexis-Nexis Thomson Research IBIS World USA Mintel Market Reports Medicine & Healthcare Topics: MEDLINE PUBMED Cumulative Index to Nursing and Allied Health (CINAHL) Health Business Full-Text Health Reference Center Academic Health Source Nursing PsycINFO Education Topics: ERIC Education Abstracts PsycINFO PAIS International Computers & Information Technology Topics: Applied Science Abstracts Computer Database INSPEC ABI-Inform Vehicle Design Topics: THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 40 INSPEC Applied Science Abstracts General Reference Business File ASAP ABI-Inform General Topics: Wilson Omnifile Select ArticleFirst General OneFile ECO Electronic Collections Online Lexis-Nexis All of these databases are available through the GCLS web site from this page: http://libguides.ocls.cmich.edu/databases. Off-campus users will have to authenticate with their Global ID and passwords to gain access. 2. Books Centra, the CMU Libraries’ online catalog, contains records of the books and journals held by the CMU Libraries. Go to http://centra.cmich.edu/ to search the library’s catalog. 3. Sample MSA 699 Projects Sample copies of MSA 699 projects are available for download or viewing on the GCLS Web site. Go to http://libguides.ocls.cmich.edu/content.php?pid=28304&sid=230754 to see a listing of available projects. 4. Style Manuals Information about citing sources and creating lists of references is at http://libguides.ocls.cmich.edu/content.php?pid=27285&sid=197831. Librarian Assistance CMU’s Global Campus Library Services librarians can help you find relevant information by directing you to appropriate resources, suggesting useful search terms and strategies, and answering any questions about the library’s resources and services and how to take full advantage of them. Librarian Contact Information:  (800) 544-1452  Ask a Librarian online form at http://ocls.cmich.edu/reference/index.html THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 41 Documents on Demand service Use the CMU Library’s Documents on Demand service to request full-text copies of articles, book chapters, and books needed for your research. Items will be delivered either electronically or in print, depending on your preference. If a requested item is not available in the CMU Library’s collections, it may be ordered from another university library through interlibrary loan. Document Delivery Contact Information:  Email: docreq@cmich.edu  (800) 274-3838 (877) 329-6257 (toll free fax in U.S. and Canada) For a full listing of Document on Demand services and contact information go to http://ocls.cmich.edu/delivery/index.html THE STUDENT GUIDE TO THE MSA CAPSTONE PROJECT, Part 2 August 2012 Page 42 RRA Tips What the Reviewer looks for: This document is intended to give guidance to students and faculty about the content of the RRA form and supporting materials. This is not intended as an exhaustive document, but intended to give insight into the research review application process. The reviewer does not typically review the research proposal. Therefore, it is the responsibility of the student and the capstone instructor to provide enough information about the project in the RRA form and, if applicable, supporting documents. The reviewer should be able to say, yes, I know what the project is about, who the subjects will be, how they are selected, what methodology will be used, that all consent documents contain the appropriate elements of consent, and that the survey/interview questions are reasonable in terms of balancing risks and benefits. It is the responsibility of the reviewer to ask for clarification if the research cannot be understood and/or if elements are missing or materials should be revised. The ultimate goal is to insure human subject protection. The reviewer will determine that nothing in the proposed project constitutes an unacceptable level of risk. Please note that these are administrative projects and typically the risks that need to be addressed have to do with anonymity issues. Students often want to ask for demographic information that is not needed or fail to realize that demographic questions are not appropriate for a small subject pool. Occasionally, topics and survey questions/interview questions have content that could distress the participants, such as PTSD, toxic leadership, sexual harassment, or workplace violence. The reviewer considers how the impact on a potential participant and make a judgment whether the questions are distressing. In cases where this determination is made, the review works with the student and faculty monitor to restructure questions. In extreme cases, approval cannot be granted and this is communicated. In cases where risk is identified, the IRB office may be consulted either for guidance or to seek a second opinion. Assuming minimal risk, the reviewer may give recommendations to improve a research design, comment on question wording, and so forth. Egregious spelling errors may be identified. RRA tips/what the reviewer looks for Page 1 Application requirement The student researcher describes the purpose of the research project What does the reviewer looks for? The reviewer makes a determination that the project is appropriate for a degree in administration. The student researcher will need to articulate that there is an administrative component in the research. Guidance is provided in the Student Guide and seven typologies are suggested as frameworks for the research: 1. 2. 3. 4. 5. 6. 7. Hypothesis Testing Cost Benefit/Effectiveness Analysis Feasibility Study Policy Analysis Program Design Operations Research Program Evaluation Source of the Has the student provided a signed permission letter (on letterhead) from the subject pool or appropriate administrator which authorizes access to the subject pool or to human subjects data the human subjects data? If the subject pool is a public source, has this been described and is it verifiable? For example, if the URL for an online directory is provided, confirm that public access is allowable. Otherwise, require a permission letter. Number of subjects This can be a real challenge in some student projects. In small organizations, the potential subject pool may be very small. The reviewer must compare demographic questions to the size of the subject pool. The number of responses under each demographic question is also a matter of concern. For example, if the demographic questions include gender, ethnicity, years of employee, and position, the combined responses to these questions could serve to identify individual participants. The reviewer should point this out and suggest remedies, such as eliminating demographic questions, reducing the number of selections for each demographic question, broadening ranges, or making responses less specific (generic titles, rather than specific titles). It is appropriate to probe whether demographics are really necessary to the student’s data analysis or whether this was just interesting information to ask. Selection criteria In an ideal world, there are unlimited participants available and subjects can be selected using a random number table or some sort of systematic approach. Also, ideally, subject groups (male/female, ethnicities) are fairly represented in the selected subject pool. Student researchers will typically use the entire available population, a convenience population, or a systematically selected (for example, every 3rd name on a list) subject pool. If unclear, the reviewer should ask the student to clarify the selection process, if any. Relationship to This question is asked to determine if there needs to be any language in the subjects consent documents about the relationship and for the reviewer to assess whether there is any potential for coercion (or the perception of coercion) in the research design. If subjects are co-workers or superiors, there are typically no issues. However, if the student researcher supervises some or all of the research subjects, this should be clearly pointed out in the consent documents and subjects clearly informed that they can make the decision to participate or not to participate. Surveys that can be returned anonymously RRA tips/what the reviewer looks for Page 2 Overall description of subject pool/human subjects data Describe the research methodology Consent document (and with no or few demographics) pose the least amount of issues. Face to face interviews do carry the potential for a perception of coercion on the part of the participant. The reviewer can certainly ask the student researcher to articulate how this possible perception will be alleviated. Other relationship issues are the coach/athlete relationship or the teacher/student relationship. Care should be taken in the consent document language and that the research design allows for anonymous return. 1. Based on the proposed topic and review of survey and/or interview questions, is the subject pool appropriate? In other words, can the proposed participants be expected to answer the questions? 2. Has the subject pool been adequately described? 3. Has the student researcher provided enough information about human subjects data? (source, data recording sheet, how data will be deidentified, and so forth) Has the researcher adequately described the researcher methodology? If surveys are planned, how will the survey be distributed and collected? If interviews are planned, where will the interviews take place, and are the interviews in person or by phone? If human subjects data is used, what is the source of the data, what part of the data will be used in the project, what is the process for collecting the data, and how will subject information be deidentified for use in the project? If subjects are underage, what are the procedures for insuring that the parental/guardian consent and the child assent are in place prior to the administration of the survey/interview. Is there a consent document for every planned methodology? In other words, is there a survey cover letter for the survey, a consent form for planned interviews, and so forth? Does the consent document follow the template? Typical elements of consent (includes items specific to MSA): 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. RRA tips/what the reviewer looks for Student researcher identifies himself or herself as a CMU graduate student Purpose of study Criteria for participating (how selected) That participation is voluntary What is expected of the subject (complete the survey/participate in the interview) Instructions on returning the survey anonymously Time commitment Age disclaimer, if there is any possibility that the survey could go to someone under the age of 18. Compensation, if any Benefits (Offer to share project summary) and other benefits (shared with HR department, shared with CEO, etc.) Survey link (or text placeholder) if an online survey is planned Contact information for MSA program office (for anonymous complaints/concerns) Contact information for student researcher and faculty monitor (capstone instructor) Page 3 Survey/interview questions Review the survey/interview questions for the following: 1. 2. 3. 4. Other issues Underage subjects Social media Online surveys If instructions are provided, do the instructions match the instructions in the consent document? Potential for subjects to be identified (are there excessive demographics, too many response categories, etc.) Potential risk either because of the subject matter (violence in the workplace, drug abuse, domestic abuse) Risk because the subject is asked to comment on a supervisor. The reviewer should ascertain whether there are multiple supervisors, can responses be tracked back to individual participants, can responses be reworded, for example, “management”, rather than “my supervisor.” MSA student researchers do not typically use underage subjects as research subjects. In the few cases that come up, the reviewer should provide guidance. Following the IRB templates, the student should develop a parental/guardian consent form and a child assent form. This can be a combined form. The student researcher should also articulate how the signed forms will be in place prior to the administration of the survey or interview. Survey or interview questions should be reviewed for appropriateness. Student researchers will increasingly use social media as a means to distribute surveys. The reviewer needs to apply a test of reasonableness when reviewing applications. Many social media sites have groups and members can post surveys on the group sites. Student researchers may state that they are using SurveyMonkey to distribute their survey. It is allowable for student researchers to pay for survey panels. The reviewer will need to ask the student to confirm that this is the case. The fact of using an online survey system doesn’t necessarily imply permission to use a subject pool. Students should be reminded that it is not appropriate to collect IP addresses. In order to assist student researchers, the Student Guide to the MSA Capstone Project, part 2, contains a variety of samples RRA forms, permission letters, cover letters, and sample text for the RRA form under a variety of scenarios. Student Guide to the MSA Capstone Project http://www.grad.cmich.edu/msa/researchreview RRA tips/what the reviewer looks for Page 4
Purchase answer to see full attachment
User generated content is uploaded by users for the purposes of learning and should be used following Studypool's honor code & terms of service.

Explanation & Answer

Which one yo...

Related Tags