%PDF-1.4
%
1 0 obj
<<
/Title (Getting the EPA back on track)
/Author (American Association for the Advancement of Science)
/Creator (DALiM Software Applications)
/ModDate (D:20191207222043-05'00')
/Trapped /True
/Keywords (Science Magazine Article)
/Producer (Science Journals - Operations)
/CreationDate (D:20191204102026+05'00')
/PXCViewerInfo (PDF-XChange Viewer;2.5.316.1;Jan 18 2016;09:02:08;D:20191207222043-05'00')
>>
endobj
2 0 obj
<<
/Type /Catalog
/Pages 3 0 R
/Metadata 4 0 R
>>
endobj
3 0 obj
<<
/Kids [5 0 R 6 0 R]
/Type /Pages
/Count 2
>>
endobj
4 0 obj
<<
/Type /Metadata
/Length 3562
/Subtype /XML
>>
stream
This is the wrong way to start science and the right way to protect faulty data and/or analysis from oversight. It is almost always possible to protect personal identity, for example by providing the data to a trusted 3rd party or by micro aggregation. In any case, once a person dies they are no longer considered a person.
) /Name /Comment /Rect [229.5 559.374195 249.5 577.374195] /Subj (Sticky Note) /Popup 10 0 R /Subtype /Text /Contents (This is the wrong way to start science and the right way to protect faulty data and/or analysis from oversight. It is almost always possible to protect personal identity, for example by providing the data to a trusted 3rd party or by micro aggregation. In any case, once a person dies they are no longer considered a person.) /CreationDate (D:20191206231745-05'00') >> endobj 10 0 obj << /F 25 /M (D:20191207220919-05'00') /P 5 0 R /NM (b8968b79-aec7-4355-9b64a8ad421a5b2e) /Open false /Rect [45 563.642499 281.25 722.842499] /Parent 9 0 R /Subtype /Popup >> endobj 11 0 obj << /C [1 1 0] /F 28 /M (D:20191207220956-05'00') /P 5 0 R /T (User) /AP << /N 64 0 R >> /NM (48d6835d-4229-4141-932ca8bc6e36ce6b) /RC (This statement is a logical non sequitur.
) /Name /Comment /Rect [184.5 515.883672 204.5 533.883672] /Subj (Sticky Note) /Popup 12 0 R /Subtype /Text /Contents (This statement is a logical non sequitur.) /CreationDate (D:20191206232159-05'00') >> endobj 12 0 obj << /F 25 /M (D:20191207220956-05'00') /P 5 0 R /NM (f4192981-ca64-4e4a-ad8d9b3d8a9c5e9b) /Open false /Rect [285 523.618477 435 603.618477] /Parent 11 0 R /Subtype /Popup >> endobj 13 0 obj << /C [1 1 0] /F 28 /M (D:20191207221026-05'00') /P 5 0 R /T (User) /AP << /N 65 0 R >> /NM (45887907-ddb8-4147-b1d64906fc8a45e0) /RC (This statement assumes that which is to be proved. There is new and substantial evidence that there is no association of key air components and mortality. See
https://junkscience.com/2018/06/negative-studies-and-pm2-5/#more-93941.
It takes only one valid negative study to negate positive association studies. Young et al. 2017 provided the data set used in this study in 2015. The claim of no effect has not been challenged.
) /Name /Comment /Rect [192.75 494.13841 212.75 512.13841] /Subj (Sticky Note) /Popup 14 0 R /Subtype /Text /Contents (This statement assumes that which is to be proved. There is new and substantial evidence that there is no association of key air components and mortality. See\rhttps://junkscience.com/2018/06/negative-studies-and-pm2-5/#more-93941. \r\rIt takes only one valid negative study to negate positive association studies. Young et al. 2017 provided the data set used in this study in 2015. The claim of no effect has not been challenged.) /CreationDate (D:20191206232248-05'00') >> endobj 14 0 obj << /F 25 /M (D:20191207221026-05'00') /P 5 0 R /NM (36fecd23-3023-4684-b5cd2547c440f31f) /Open false /Rect [24 536.954589 504.75 667.354589] /Parent 13 0 R /Subtype /Popup >> endobj 15 0 obj << /C [1 1 0] /F 28 /M (D:20191206233253-05'00') /P 5 0 R /T (User) /AP << /N 66 0 R >> /NM (8621f4db-0bef-432f-86083b814d9f0572) /RC (The great majority of the public responses were form letters in effect. The only way to know the reliability of previous studies is to examine the data and analysis methods. Epidemiology has a very poor record of reliability.
) /Name /Comment /Rect [239.25 296.181543 259.25 314.181543] /Subj (Sticky Note) /Popup 16 0 R /Subtype /Text /Contents (The great majority of the public responses were form letters in effect. The only way to know the reliability of previous studies is to examine the data and analysis methods. Epidemiology has a very poor record of reliability.) /CreationDate (D:20191206233045-05'00') >> endobj 16 0 obj << /F 25 /M (D:20191207221043-05'00') /P 5 0 R /NM (eaa18db9-9ae9-468a-94a99db69ea7c1ba) /Open false /Rect [35.25 360.452461 388.5 447.652461] /Parent 15 0 R /Subtype /Popup >> endobj 17 0 obj << /C [1 1 0] /F 28 /M (D:20191206233553-05'00') /P 5 0 R /T (User) /AP << /N 67 0 R >> /NM (6c310bec-0f54-43e5-8395cab25a7e6699) /RC (Again, one a person is dead they are no longer considered a person. In most states a death certificate is considered a public record.
Also, if a researcher thinks their data set is not open to examination, they might consider bending the data or analysis to a particular conclusion.
) /Name /Comment /Rect [163.5 232.44543 183.5 250.44543] /Subj (Sticky Note) /Popup 18 0 R /Subtype /Text /Contents (Again, one a person is dead they are no longer considered a person. In most states a death certificate is considered a public record.\r\rAlso, if a researcher thinks their data set is not open to examination, they might consider bending the data or analysis to a particular conclusion.) /CreationDate (D:20191206233319-05'00') >> endobj 18 0 obj << /F 25 /M (D:20191207221103-05'00') /P 5 0 R /NM (7cbfc8b9-bd6d-4170-9752855173153fa4) /Open false /Rect [33.75 334.055075 435.75 435.655075] /Parent 17 0 R /Subtype /Popup >> endobj 19 0 obj << /C [1 1 0] /F 28 /M (D:20191206233714-05'00') /P 5 0 R /T (User) /AP << /N 68 0 R >> /NM (5d897f2c-fa53-4df4-9292888ef50762c2) /RC (Key environmental epidemiology data sets are aggregated to the day and the people are dead.
) /Name /Comment /Rect [133.5 190.45458 153.5 208.45458] /Subj (Sticky Note) /Popup 20 0 R /Subtype /Text /Contents (Key environmental epidemiology data sets are aggregated to the day and the people are dead.) /CreationDate (D:20191206233611-05'00') >> endobj 20 0 obj << /F 25 /M (D:20191206233730-05'00') /P 5 0 R /NM (6f505dbf-77ac-4871-892d9f84a16ef1cc) /Open false /Rect [33 266.728439 303.75 328.428439] /Parent 19 0 R /Subtype /Popup >> endobj 21 0 obj << /C [1 1 0] /F 28 /M (D:20191206233823-05'00') /P 5 0 R /T (User) /AP << /N 69 0 R >> /NM (b3d9aa6c-afe6-46b1-a1cfe4ed20ac57cf) /RC (None of this matters if the person is dead.
) /Name /Comment /Rect [203.25 137.966017 223.25 155.966017] /Subj (Sticky Note) /Popup 22 0 R /Subtype /Text /Contents (None of this matters if the person is dead.) /CreationDate (D:20191206233752-05'00') >> endobj 22 0 obj << /F 25 /M (D:20191206233823-05'00') /P 5 0 R /NM (3d493ca0-471b-42b2-a3ee9e9631d017e3) /Open false /Rect [230.25 180.943143 380.25 260.943143] /Parent 21 0 R /Subtype /Popup >> endobj 23 0 obj << /C [1 1 0] /F 28 /M (D:20191206234010-05'00') /P 5 0 R /T (User) /AP << /N 70 0 R >> /NM (0299a32e-9bc1-436d-b033330bc4b4572a) /RC (Drug companies provide data sets to a trusted 3rd party, the FDA. In the case of public health, courts can order the availability of data.
) /Name /Comment /Rect [460.5 578.869947 480.5 596.869947] /Subj (Sticky Note) /Popup 24 0 R /Subtype /Text /Contents (Drug companies provide data sets to a trusted 3rd party, the FDA. In the case of public health, courts can order the availability of data.) /CreationDate (D:20191206233844-05'00') >> endobj 24 0 obj << /F 25 /M (D:20191207221129-05'00') /P 5 0 R /NM (a69be3f4-e0f4-456f-8144fd4abcd43fb0) /Open false /Rect [251.25 473.830894 546.75 546.630894] /Parent 23 0 R /Subtype /Popup >> endobj 25 0 obj << /C [1 1 0] /F 28 /M (D:20191207221159-05'00') /P 5 0 R /T (User) /AP << /N 71 0 R >> /NM (0dfee032-035e-4336-aa8ff6ffca31dfcd) /RC (Having an agenda cuts both ways. Grant seekers can have an agenda, prestige or continued grant support. In any case, if the data is public flawed analysis by industry can be uncovered.
) /Name /Comment /Rect [448.5 526.381384 468.5 544.381384] /Subj (Sticky Note) /Popup 26 0 R /Subtype /Text /Contents (Having an agenda cuts both ways. Grant seekers can have an agenda, prestige or continued grant support. In any case, if the data is public flawed analysis by industry can be uncovered.) /CreationDate (D:20191206234031-05'00') >> endobj 26 0 obj << /F 25 /M (D:20191207221159-05'00') /P 5 0 R /NM (34146813-ad0a-43f7-ae002b2a144d3a38) /Open false /Rect [251.25 423.438736 540 510.638736] /Parent 25 0 R /Subtype /Popup >> endobj 27 0 obj << /C [1 1 0] /F 28 /M (D:20191206234406-05'00') /P 5 0 R /T (User) /AP << /N 72 0 R >> /NM (c3544956-4667-49d6-84c50dee7f3115f3) /RC (One valid negative study, overcomes weight of evidence.
) /Name /Comment /Rect [414.75 482.89086 434.75 500.89086] /Subj (Sticky Note) /Popup 28 0 R /Subtype /Text /Contents (One valid negative study, overcomes weight of evidence.) /CreationDate (D:20191206234303-05'00') >> endobj 28 0 obj << /F 25 /M (D:20191206234411-05'00') /P 5 0 R /NM (eeeba7ca-a9a9-4c47-961e681a4f6287a7) /Open false /Rect [251.25 409.498049 499.5 467.898049] /Parent 27 0 R /Subtype /Popup >> endobj 29 0 obj << /C [1 1 0] /F 28 /M (D:20191206235146-05'00') /P 5 0 R /T (User) /AP << /N 73 0 R >> /NM (7a13cdd7-6095-4c85-9a6ee37a96f0b51b) /RC (Multiple similar results might be thought definitive. Not so fast. See
Head ML, Holman L, Lanfear R, Kahn AT, Jennions, MD. 2015. The extent and consequences of p-hacking in science. PLoS Biol. 13\(3\):e1002106.
doi:10.1371/journal.pbio.1002106.
Nissen SB, Magidson T, Gross K, Bergstrom CT. 2016. Publication bias and the
canonization of false facts. eLife. 5:e21451. doi:10.7554/eLife.21451.
Simonsohn U, Nelson LD, Simmons JP. 2014. P-curve: A key to the file-drawer. J
Experimental Psychol: General. 143:534−547. doi: 10.1037/a0033242.
In addition, results of Young and Kindzierski point to serious replication problems with environmental epidemiology:
Young SS, Kindzierski KB. 2019. Combined background information for meta-analysis evaluation. https://arxiv.org/abs/1808.04408
Young SS, Kindzierski KB. 2019. Evaluation of a meta-analysis of air quality and heart attacks, a case study, Critical Reviews in Toxicology, doi: 10.1080/10408444.2019.1576587
) /Name /Comment /Rect [428.25 452.897396 448.25 470.897396] /Subj (Sticky Note) /Popup 30 0 R /Subtype /Text /Contents (Multiple similar results might be thought definitive. Not so fast. See\r\rHead ML, Holman L, Lanfear R, Kahn AT, Jennions, MD. 2015. The extent and consequences of p-hacking in science. PLoS Biol. 13\(3\):e1002106. \rdoi:10.1371/journal.pbio.1002106.\r\rNissen SB, Magidson T, Gross K, Bergstrom CT. 2016. Publication bias and the \rcanonization of false facts. eLife. 5:e21451. doi:10.7554/eLife.21451.\r\rSimonsohn U, Nelson LD, Simmons JP. 2014. P-curve: A key to the file-drawer. J \rExperimental Psychol: General. 143:534547. doi: 10.1037/a0033242.\r\rIn addition, results of Young and Kindzierski point to serious replication problems with environmental epidemiology:\r\rYoung SS, Kindzierski KB. 2019. Combined background information for meta-analysis evaluation. https://arxiv.org/abs/1808.04408\r\rYoung SS, Kindzierski KB. 2019. Evaluation of a meta-analysis of air quality and heart attacks, a case study, Critical Reviews in Toxicology, doi: 10.1080/10408444.2019.1576587 \r ) /CreationDate (D:20191206234426-05'00') >> endobj 30 0 obj << /F 25 /M (D:20191206235146-05'00') /P 5 0 R /NM (e171a423-80c3-4984-ab0a843dd18500c7) /Open false /Rect [128.25 102.002297 582 448.402297] /Parent 29 0 R /Subtype /Popup >> endobj 31 0 obj << /C [1 1 0] /F 28 /M (D:20191206235454-05'00') /P 5 0 R /T (User) /AP << /N 74 0 R >> /NM (7c14de96-c427-4201-a5bb16b6781cc024) /RC (
And just how is the EPA to know the reliability of studies if they don't examine the data and methods?
The Data Quality Act would seem to require access to data.
) /Name /Comment /Rect [413.25 389.91112 433.25 407.91112] /Subj (Sticky Note) /Popup 32 0 R /Subtype /Text /Contents (And just how is the EPA to know the reliability of studies if they don't examine the data and methods?\r\rThe Data Quality Act would seem to require access to data.) /CreationDate (D:20191206235308-05'00') >> endobj 32 0 obj << /F 25 /M (D:20191207221219-05'00') /P 5 0 R /NM (a17a9c65-e543-4677-96485e53b672ab09) /Open false /Rect [251.25 328.653114 526.5 444.653114] /Parent 31 0 R /Subtype /Popup >> endobj 33 0 obj << /C [1 1 0] /F 28 /M (D:20191206235612-05'00') /P 5 0 R /T (User) /AP << /N 75 0 R >> /NM (dfa5dee0-49d3-45c9-84fd54310c9f1ba5) /RC (Peer review is known to be ineffective. See Feinstein, Science, 1988 and others.
) /Name /Comment /Rect [385.5 284.184157 405.5 302.184157] /Subj (Sticky Note) /Popup 34 0 R /Subtype /Text /Contents (Peer review is known to be ineffective. See Feinstein, Science, 1988 and others.) /CreationDate (D:20191206235518-05'00') >> endobj 34 0 obj << /F 25 /M (D:20191207221234-05'00') /P 5 0 R /NM (2d061910-a9c3-4fe3-aa5fd14990e1ff40) /Open false /Rect [252.75 217.987915 506.25 284.937915] /Parent 33 0 R /Subtype /Popup >> endobj 35 0 obj << /C [1 1 0] /F 28 /M (D:20191207221329-05'00') /P 5 0 R /T (User) /AP << /N 76 0 R >> /NM (5025ca49-a46f-4056-88ee7ab7b4b34989) /RC (The H6C study has been in dispute since publication. A contemporary study, Styer et al. 1995, also funded by EPA was negative. The ACS data has been obtained and reanalysis is negative, Enstrom 2017.
) /Name /Comment /Rect [355.5 200.952293 375.5 218.952293] /Subj (Sticky Note) /Popup 36 0 R /Subtype /Text /Contents (The H6C study has been in dispute since publication. A contemporary study, Styer et al. 1995, also funded by EPA was negative. The ACS data has been obtained and reanalysis is negative, Enstrom 2017. ) /CreationDate (D:20191206235637-05'00') >> endobj 36 0 obj << /F 25 /M (D:20191207221329-05'00') /P 5 0 R /NM (066cd2f0-dfe3-48a5-965c24ab740444c4) /Open false /Rect [251.25 89.608338 540 191.208338] /Parent 35 0 R /Subtype /Popup >> endobj 37 0 obj << /C [1 1 0] /F 28 /M (D:20191207000634-05'00') /P 5 0 R /T (User) /AP << /N 77 0 R >> /NM (3dd6cad8-89ea-448c-a9b5b1c426496537) /RC (Just how reliable are studies where data and analysis code are not available, even to trusted 3rd parties?
Sharing Research Data http://www.nap.edu/catalog/2033.html
"This case suggests that an agency can insulate its actions from public
scrutiny by funding a grant for controversial research and then basing its action on those findings. As long as the agency does not take possession or control of the records, the FOIA will not assist those who wish to challenge the findings that underlie the agency action."
) /Name /Comment /Rect [464.25 167.209645 484.25 185.209645] /Subj (Sticky Note) /Popup 38 0 R /Subtype /Text /Contents (Just how reliable are studies where data and analysis code are not available, even to trusted 3rd parties?\r\rSharing Research Data http://www.nap.edu/catalog/2033.html\r\r"This case suggests that an agency can insulate its actions from public\rscrutiny by funding a grant for controversial research and then basing its action on those findings. As long as the agency does not take possession or control of the records, the FOIA will not assist those who wish to challenge the findings that underlie the agency action." ) /CreationDate (D:20191207000026-05'00') >> endobj 38 0 obj << /F 25 /M (D:20191207221403-05'00') /P 5 0 R /NM (8d52589b-f6d1-44b3-a0b9bdc2e8971861) /Open false /Rect [120 102.034647 536.25 299.934647] /Parent 37 0 R /Subtype /Popup >> endobj 39 0 obj << /Filter [/FlateDecode] /Length 8969 >> stream HWn}Wԣ4yxvg] `bK"T"cPd_O:ugUV~jUzCV?T|u_VP[]^z6ow_V ~_W_R~ɳiuwwk?8rSя?'ϕGM )LMPyu{q_B/yQ\j<>zmnWRiH+?t )x]p]7K 76+KiLw"3Ӫ:֔rB"UW%=AӣiV̈ azlGrnYJFj^Wcqq|zMI K`ULÇrvEr6E8auqiw 4UِY/ӄVVu3ySW{:,KxPsH"@W^>i"&Ѽ͢0zyjkXg)cn6fM>j͆(5x63C_ =Lϧ`b xbkpp;]7Hŕ ɟ878{|%|orvdtG0Q2^ 0g'x)ϞT5H0="&Ppscth>I[]*3Rpz8ת Np\쿈Psu0Yvq\ݯv\<"X>Ȱ/YnjǶC+-T/6w-B3 M#&lcSP*eS)0~D#>`ѦD*'xsxXzvmUc)bWv*J*.NN%Q F줏4<[G$gSnALٟ~)aVkPlg |M%48!аB:M|FkIkjQ)uHx;UIL hbXXSFU+s:i@YDH(0uɉӉaDr˓fNi/epO 9:(4BliZo!:ڎ,Dc"9Z