Statistical Significance and Meaningfulness

Anonymous
account_balance_wallet \$20

Question description

Discussion: Statistical Significance and Meaningfulness

Once you start to understand how exciting the world of statistics can be, it is tempting to fall into the trap of chasing statistical significance. That is, you may be tempted always to look for relationships that are statistically significant and believe they are valuable solely because of their significance. Although statistical hypothesis testing does help you evaluate claims, it is important to understand the limitations of statistical significance and to interpret the results within the context of the research and its pragmatic, “real world” application.

As a scholar-practitioner, it is important for you to understand that just because a hypothesis test indicates a relationship exists between an intervention and an outcome, there is a difference between groups, or there is a correlation between two constructs, it does not always provide a default measure for its importance. Although relationships are significant, they can be very minute relationships, very small differences, or very weak correlations. In the end, we need to ask whether the relationships or differences observed are large enough that we should make some practical change in policy or practice.

For this Discussion, you will explore statistical significance and meaningfulness.

To prepare for this Discussion:

• Review the Learning Resources related to hypothesis testing, meaningfulness, and statistical significance.
• Review Magnusson’s web blog found in the Learning Resources to further your visualization and understanding of statistical power and significance testing.
• Review the American Statistical Association’s press release and consider the misconceptions and misuse of p-values.
• Consider the scenario:
• A research paper claims a meaningful contribution to the literature based on finding statistically significant relationships between predictor and response variables. In the footnotes, you see the following statement, “given this research was exploratory in nature, traditional levels of significance to reject the null hypotheses were relaxed to the .10 level.”

By Day 3

Be sure to support your Main Post and Response Post with reference to the week’s Learning Resources and other scholarly evidence in APA Style.

Week 5 Scenarios 1. The p-value was slightly above conventional threshold, but was described as “rapidly approaching significance” (i.e., p =.06). An independent samples t test was used to determine whether student satisfaction levels in a quantitative reasoning course differed between the traditional classroom and on-line environments. The samples consisted of students in four face-to-face classes at a traditional state university (n = 65) and four online classes offered at the same university (n = 69). Students reported their level of satisfaction on a fivepoint scale, with higher values indicating higher levels of satisfaction. Since the study was exploratory in nature, levels of significance were relaxed to the .10 level. The test was significant t(132) = 1.8, p = .074, wherein students in the face-to-face class reported lower levels of satisfaction (M = 3.39, SD = 1.8) than did those in the online sections (M = 3.89, SD = 1.4). We therefore conclude that on average, students in online quantitative reasoning classes have higher levels of satisfaction. The results of this study are significant because they provide educators with evidence of what medium works better in producing quantitatively knowledgeable practitioners. 2. A results report that does not find any effect and also has small sample size (possibly no effect detected due to lack of power). A one-way analysis of variance was used to test whether a relationship exists between educational attainment and race. The dependent variable of education was measured as number of years of education completed. The race factor had three attributes of European American (n = 36), African American (n = 23) and Hispanic (n = 18). Descriptive statistics indicate that on average, European Americans have higher levels of education (M = 16.4, SD = 4.6), with African Americans slightly trailing (M = 15.5, SD = 6.8) and Hispanics having on average lower levels of educational attainment (M = 13.3, SD = 6.1). The ANOVA was not significant F (2,74) = 1.789, p = .175, indicating there are no differences in educational attainment across these three races in the population. The results of this study are significant because they shed light on the current social conversation about inequality. 3. Statistical significance is found in a study, but the effect in reality is very small (i.e., there was a very minor difference in attitude between men and women). Were the results meaningful? An independent samples t test was conducted to determine whether differences exist between men and women on cultural competency scores. The samples consisted of 663 women and 650 men taken from a convenience sample of public, private, and non-profit organizations. Each participant was administered an instrument that measured his or her current levels of cultural competency. The © 2016 Laureate Education, Inc. Page 1 of 2 cultural competency score ranges from 0 to 10, with higher scores indicating higher levels of cultural competency. The descriptive statistics indicate women have higher levels of cultural competency (M = 9.2, SD = 3.2) than men (M = 8.9, SD = 2.1). The results were significant t (1311) = 2.0, p <.05, indicating that women are more culturally competent than are men. These results tell us that gender-specific interventions targeted toward men may assist in bolstering cultural competency. 4. A study has results that seem fine, but there is no clear association to social change. What is missing? A correlation test was conducted to determine whether a relationship exists between level of income and job satisfaction. The sample consisted of 432 employees equally represented across public, private, and non-profit sectors. The results of the test demonstrate a strong positive correlation between the two variables, r =.87, p < .01, showing that as level of income increases, job satisfaction increases as well. © 2016 Laureate Education, Inc. Page 2 of 2

Ryann N
School: Purdue University

Attached.

Running head: STATISTICAL SIGNIFICANCE AND MEANINGFULNESS

Statistical Significance and Meaningfulness
Name
Institution

1

STATISTICAL SIGNIFICANCE AND MEANINGFULNESS

2

The determination of significance, in this case, does not necessarily mean that there is a
relationship that exists between the predictor variables and response variables. In this case, the
level of significance was relaxed to 0.1. This shows that a 10% error has bee...

flag Report DMCA
Review

Anonymous
Top quality work from this guy! I'll be back!

Brown University

1271 Tutors

California Institute of Technology

2131 Tutors

Carnegie Mellon University

982 Tutors

Columbia University

1256 Tutors

Dartmouth University

2113 Tutors

Emory University

2279 Tutors

Harvard University

599 Tutors

Massachusetts Institute of Technology

2319 Tutors

New York University

1645 Tutors

Notre Dam University

1911 Tutors

Oklahoma University

2122 Tutors

Pennsylvania State University

932 Tutors

Princeton University

1211 Tutors

Stanford University

983 Tutors

University of California

1282 Tutors

Oxford University

123 Tutors

Yale University

2325 Tutors