Data Mining- Avoiding False Discoveries

Answer the following questions: (10 point each)
 

  1. Which of the following are suitable null hypotheses? If not, explain why.
  2. Comparing two groups Consider comparing the average blood pressure of a group of subjects, both before and after they are placed on a low salt diet. In this case, the null hypothesis is that a low salt diet does reduce blood pressure, i.e., that the average blood pressure of the subjects is the same before and after the change in diet.
  3. Classification Assume there are two classes, labeled + and −, where we are most interested in the positive class, e.g., the presence of a disease. H 0 H0 is the statement that the class of an object is negative, i.e., that the patient does not have the disease.
  4. Association Analysis For frequent patterns, the null hypothesis is that the items are independent and thus, any pattern that we detect is spurious.
  5. Clustering The null hypothesis is that there is cluster structure in the data beyond what might occur at random.
  6. Anomaly Detection Our assumption, H 0 H0, is that an object is not anomalous.

 
 
 
 

  1. Consider once again the coffee-tea example, presented in Example 10.9. The following two tables are the same as the one presented in Example 10.9 except that each entry has been divided by 10 (left table) or multiplied by 10 (right table).

 
Table 10.7. Beverage preferences among a group of 100 people (left) and 10,000 people (right).
 
 

  1. Compute the p-value of the observed support count for each table, i.e., for 15 and 1500. What pattern do you observe as the sample size increases?

 
 
 
 
 
 
 

  1. Compute the odds ratio and interest factor for the two contingency tables presented in this problem and the original table of Example 10.9. (See Section 5.7.1 for definitions of these two measures.) What pattern do you observe?

 
 

  1. The odds ratio and interest factor are measures of effect size. Are these two effect sizes significant from a practical point of view?

 

  1. What would you conclude about the relationship between p-values and effect size for this situation?
  1. Consider the different combinations of effect size and p-value applied to an experiment where we want to determine the efficacy of a new drug.
  • effect size small, p-value small
  • effect size small, p-value large
  • effect size large, p-value small
  • effect size large, p-value large

Whether effect size is small or large depends on the domain, which in this case is medical. For this problem consider a small p-value to be less than 0.001, while a large p-value is above 0.05. Assume that the sample size is relatively large, e.g., thousands of patients with the condition that the drug hopes to treat.

  1. Which combination(s) would very likely be of interest?
  2. Which combinations(s) would very likely not be of interest?
  3. If the sample size were small, would that change your answers?

Data Mining- Avoiding False Discoveries

Answer the following questions: (10 point each)
 

  1. Which of the following are suitable null hypotheses? If not, explain why.
  2. Comparing two groups Consider comparing the average blood pressure of a group of subjects, both before and after they are placed on a low salt diet. In this case, the null hypothesis is that a low salt diet does reduce blood pressure, i.e., that the average blood pressure of the subjects is the same before and after the change in diet.
  3. Classification Assume there are two classes, labeled + and −, where we are most interested in the positive class, e.g., the presence of a disease. H 0 H0 is the statement that the class of an object is negative, i.e., that the patient does not have the disease.
  4. Association Analysis For frequent patterns, the null hypothesis is that the items are independent and thus, any pattern that we detect is spurious.
  5. Clustering The null hypothesis is that there is cluster structure in the data beyond what might occur at random.
  6. Anomaly Detection Our assumption, H 0 H0, is that an object is not anomalous.

 
 
 
 

  1. Consider once again the coffee-tea example, presented in Example 10.9. The following two tables are the same as the one presented in Example 10.9 except that each entry has been divided by 10 (left table) or multiplied by 10 (right table).

 
Table 10.7. Beverage preferences among a group of 100 people (left) and 10,000 people (right).
 
 

  1. Compute the p-value of the observed support count for each table, i.e., for 15 and 1500. What pattern do you observe as the sample size increases?

 
 
 
 
 
 
 

  1. Compute the odds ratio and interest factor for the two contingency tables presented in this problem and the original table of Example 10.9. (See Section 5.7.1 for definitions of these two measures.) What pattern do you observe?

 
 

  1. The odds ratio and interest factor are measures of effect size. Are these two effect sizes significant from a practical point of view?

 

  1. What would you conclude about the relationship between p-values and effect size for this situation?
  1. Consider the different combinations of effect size and p-value applied to an experiment where we want to determine the efficacy of a new drug.
  • effect size small, p-value small
  • effect size small, p-value large
  • effect size large, p-value small
  • effect size large, p-value large

Whether effect size is small or large depends on the domain, which in this case is medical. For this problem consider a small p-value to be less than 0.001, while a large p-value is above 0.05. Assume that the sample size is relatively large, e.g., thousands of patients with the condition that the drug hopes to treat.

  1. Which combination(s) would very likely be of interest?
  2. Which combinations(s) would very likely not be of interest?
  3. If the sample size were small, would that change your answers?

Data Mining- Avoiding False Discoveries

Answer the following questions: (10 point each)
 

  1. Which of the following are suitable null hypotheses? If not, explain why.
  2. Comparing two groups Consider comparing the average blood pressure of a group of subjects, both before and after they are placed on a low salt diet. In this case, the null hypothesis is that a low salt diet does reduce blood pressure, i.e., that the average blood pressure of the subjects is the same before and after the change in diet.
  3. Classification Assume there are two classes, labeled + and −, where we are most interested in the positive class, e.g., the presence of a disease. H 0 H0 is the statement that the class of an object is negative, i.e., that the patient does not have the disease.
  4. Association Analysis For frequent patterns, the null hypothesis is that the items are independent and thus, any pattern that we detect is spurious.
  5. Clustering The null hypothesis is that there is cluster structure in the data beyond what might occur at random.
  6. Anomaly Detection Our assumption, H 0 H0, is that an object is not anomalous.

 
 
 
 

  1. Consider once again the coffee-tea example, presented in Example 10.9. The following two tables are the same as the one presented in Example 10.9 except that each entry has been divided by 10 (left table) or multiplied by 10 (right table).

 
Table 10.7. Beverage preferences among a group of 100 people (left) and 10,000 people (right).
 
 

  1. Compute the p-value of the observed support count for each table, i.e., for 15 and 1500. What pattern do you observe as the sample size increases?

 
 
 
 
 
 
 

  1. Compute the odds ratio and interest factor for the two contingency tables presented in this problem and the original table of Example 10.9. (See Section 5.7.1 for definitions of these two measures.) What pattern do you observe?

 
 

  1. The odds ratio and interest factor are measures of effect size. Are these two effect sizes significant from a practical point of view?

 

  1. What would you conclude about the relationship between p-values and effect size for this situation?
  1. Consider the different combinations of effect size and p-value applied to an experiment where we want to determine the efficacy of a new drug.
  • effect size small, p-value small
  • effect size small, p-value large
  • effect size large, p-value small
  • effect size large, p-value large

Whether effect size is small or large depends on the domain, which in this case is medical. For this problem consider a small p-value to be less than 0.001, while a large p-value is above 0.05. Assume that the sample size is relatively large, e.g., thousands of patients with the condition that the drug hopes to treat.

  1. Which combination(s) would very likely be of interest?
  2. Which combinations(s) would very likely not be of interest?
  3. If the sample size were small, would that change your answers?
0 replies

Leave a Reply

Want to join the discussion?
Feel free to contribute!

Leave a Reply

Your email address will not be published. Required fields are marked *