Difference between revisions of "Data Validation and Quality Assessment"

From PHUSE Wiki
Jump to: navigation, search
('Current Project)
(Current Projects)
 
(11 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
{{RightTOC}}
 
{{RightTOC}}
== <big>Current Projects</big> ==
+
==<big>Current Projects</big>==
 
<br />
 
<br />
<big> Current project(s): </big><br/>
+
<big> Please follow the links below to view the current project(s): </big><br/>
<big><big><big>'''[[SDTM_Validation_Rules_Project|'''SDTM Validation Rules Project]]'''</big></big></big><br />
+
#<big><big>'''[[SDTM_Validation_Rules_Project|'''SDTM Validation Rules Project]]'''</big></big>
 +
 
 
<br />
 
<br />
  
Line 11: Line 12:
 
To join the team, please contact one of project leads [[mailto:mmolter@d-wise.com Mike Molter]] or [[mailto:Majdoub.Haloui@biogenidec.com  Majdoub Haloui]]  
 
To join the team, please contact one of project leads [[mailto:mmolter@d-wise.com Mike Molter]] or [[mailto:Majdoub.Haloui@biogenidec.com  Majdoub Haloui]]  
 
<br /><br />
 
<br /><br />
<br />
 
'''[[Data Sizing Best Practices Recommendation|Data Sizing Best Practices Recommendation]]'''
 
<br />
 
'''[[Top_20_Validation_Rule_Failures_(CBER)|'''Top 20 Validation Rule Failures ]]'''
 
<br />
 
<br />
 
'''[[CAB/VP_and_OpenCDISC_Rules_Reconciliation_Project|'''CAB/VP and OpenCDISC Rules Reconciliation Project]]'''
 
<br />
 
 
<!-- Add links to your Minutes pages by creating the page from the box and adding the name here. -->
 
<!-- Add links to your Minutes pages by creating the page from the box and adding the name here. -->
<br />
 
'''[[Group_1_%E2%80%93_Develop_Guidelines_for_Validation_Rule_Developers_(Mitra) |Group 1 - Develop Guidelines for Validation Rule Developers (Mitra)]]'''
 
<br />
 
'''[[Group_2_%E2%80%93_Assess_and_Improve_Existing_Validation_Rules_(Amy)|Group 2 - Assess and Improve Existing Validation Rules (Amy)]]'''
 
<br />
 
'''[[Group_3_%E2%80%93_Design_Change_Management_Process_(Armando)|Group 3 - Design Change Management Process (Armando)]]'''
 
<br />
 
'''[[Discussion Club: FDA/PhUSE CSS Working Group 1 Update Budapest 2012]]''' <br />
 
<br />
 
<br />
 
 
=== Completed Projects ===
 
=== Completed Projects ===
 
<br />
 
<br />
 +
#'''[[Group_1_%E2%80%93_Develop_Guidelines_for_Validation_Rule_Developers_(Mitra) |Group 1 - Develop Guidelines for Validation Rule Developers (Mitra)]]'''
 +
#'''[[Group_2_%E2%80%93_Assess_and_Improve_Existing_Validation_Rules_(Amy)|Group 2 - Assess and Improve Existing Validation Rules (Amy)]]'''
 +
#'''[[Group_3_%E2%80%93_Design_Change_Management_Process_(Armando)|Group 3 - Design Change Management Process (Armando)]]'''
 +
#'''[[Data Sizing Best Practices Recommendation|Data Sizing Best Practices Recommendation]]'''
 +
#'''[[Top_20_Validation_Rule_Failures_(CBER)|'''Top 20 Validation Rule Failures ]]'''
 +
#'''[[CAB/VP_and_OpenCDISC_Rules_Reconciliation_Project|'''CAB/VP and OpenCDISC Rules Reconciliation Project]]'''
 
#'''[[Guidelines_for_Validation_Rule_Developers|'''Guidelines for Validation Rule Developers - Complete]]'''
 
#'''[[Guidelines_for_Validation_Rule_Developers|'''Guidelines for Validation Rule Developers - Complete]]'''
 
#'''[[CCB_Study_Data_Validation_Rules_Charter|'''Change Control Board (CCB) for Study Data Validation Rules Charter - Complete]]'''
 
#'''[[CCB_Study_Data_Validation_Rules_Charter|'''Change Control Board (CCB) for Study Data Validation Rules Charter - Complete]]'''
 
<br />
 
<br />
  
= Mission =
+
==Mission==
 
This working group will focus on collaborating to develop a robust process to rapidly validate and assess data quality as data moves through the product life cycle across both industry and regulatory review. The group will discuss current pains and potential solutions around topics such as the current data validation rules as well as the CDISC Data Validation Project, development and implementation of tools, terminology, and improving the quality of the data to support analytical needs.
 
This working group will focus on collaborating to develop a robust process to rapidly validate and assess data quality as data moves through the product life cycle across both industry and regulatory review. The group will discuss current pains and potential solutions around topics such as the current data validation rules as well as the CDISC Data Validation Project, development and implementation of tools, terminology, and improving the quality of the data to support analytical needs.
  
=Background=
+
==Background==
 
FDA recently has embarked on an aggressive effort to modernize the review process that will rely on high quality standardized data to streamline acquisition, analysis, storage and reporting. This new process takes a “reviewer-centered” approach where improved data quality, accessibility and predictability will allow reviewers more time to carry out complex analyses, ask in-depth questions and address late-emerging issues.  
 
FDA recently has embarked on an aggressive effort to modernize the review process that will rely on high quality standardized data to streamline acquisition, analysis, storage and reporting. This new process takes a “reviewer-centered” approach where improved data quality, accessibility and predictability will allow reviewers more time to carry out complex analyses, ask in-depth questions and address late-emerging issues.  
 
To support the transition to a more advanced review process, FDA has initiated the Data Validation Project. The objective of the project is to evaluate existing validation rules, craft new validation rules, and implement tools to enable systematic, automatic and regular evaluation of data quality and standards conformance at the time of product submission. The project will inform reviewers of characteristics of submitted data, allow for cross-submission assessment of potential problem areas,  and help generate a better understanding of several key factors related to data standards adoption, including the rate of uptake of standardized data by sponsors, the degree of adherence to the specified standards, and the ability of reviewers to use standard-specific advanced review methods/tools.
 
To support the transition to a more advanced review process, FDA has initiated the Data Validation Project. The objective of the project is to evaluate existing validation rules, craft new validation rules, and implement tools to enable systematic, automatic and regular evaluation of data quality and standards conformance at the time of product submission. The project will inform reviewers of characteristics of submitted data, allow for cross-submission assessment of potential problem areas,  and help generate a better understanding of several key factors related to data standards adoption, including the rate of uptake of standardized data by sponsors, the degree of adherence to the specified standards, and the ability of reviewers to use standard-specific advanced review methods/tools.
  
= Leadership =
+
==Leadership==
  
 
{| class="wikitable"
 
{| class="wikitable"
Line 63: Line 52:
 
|}
 
|}
  
= Approach =
+
==Approach==
 
The success of FDA initiatives depends on close collaboration with industry stakeholders including standards development organizations, sponsors, and academia. The approach for this working group is to provide a platform enabling open communication between FDA and industry to share ideas, experiences and expectations, and to facilitate joint development of validation rules and processes to assess data quality and standards compliance throughout the product life cycle.
 
The success of FDA initiatives depends on close collaboration with industry stakeholders including standards development organizations, sponsors, and academia. The approach for this working group is to provide a platform enabling open communication between FDA and industry to share ideas, experiences and expectations, and to facilitate joint development of validation rules and processes to assess data quality and standards compliance throughout the product life cycle.
  
=Scope=
+
==Scope==
 
The workgroup will initially focus on SDTM Validation Rule project. The purpose of this project is to continue the effort of improving SDTM validation rules, ensuring that all rules are both clear and effective for use by industry and by FDA. The goal is to determine new rules that will add value and manage rules that need clarification. This will involve coordinating with CDISC, OpenCDISC and FDA to propose solutions.
 
The workgroup will initially focus on SDTM Validation Rule project. The purpose of this project is to continue the effort of improving SDTM validation rules, ensuring that all rules are both clear and effective for use by industry and by FDA. The goal is to determine new rules that will add value and manage rules that need clarification. This will involve coordinating with CDISC, OpenCDISC and FDA to propose solutions.
 +
==How to join==
 +
If you are interested in joining a working group 1, follow the instructions below.
  
= Meeting Minutes =
+
#Navigate to https://www.listbox.com/subscribe/
 +
#Enter in one of the four groups below:
 +
#*WG1-Data-Validation (Working Group 1: Data Validation and Quality Assessment)
 +
#Enter your e-mail and click submit. You will then be prompted to enter your First and Last name which is required to participate in the working group 1
 +
#You will then receive an e-mail that will provide a link for you to confirm your e-mail (Check those spam folders just in case)
 +
#You are now subscribed and should receive information about upcoming meetings from working group co-leaders!
 +
 
 +
<br />
 +
 
 +
==Meeting Minutes==
 
'''Data Quality Leadership Team Minutes'''
 
'''Data Quality Leadership Team Minutes'''
 
<br /><br />
 
<br /><br />
Line 83: Line 83:
 
</inputbox>
 
</inputbox>
 
<br />
 
<br />
 
+
==Group Meeting Agenda==  
=Completed or Reorganized Projects=
 
<br />
 
'''[[Data Sizing Best Practices Recommendation|Data Sizing Best Practices Recommendation]]'''
 
<br />
 
'''[[Top_20_Validation_Rule_Failures_(CBER)|'''Top 20 Validation Rule Failures ]]'''
 
<br />
 
<br />
 
'''[[CAB/VP_and_OpenCDISC_Rules_Reconciliation_Project|'''CAB/VP and OpenCDISC Rules Reconciliation Project]]'''
 
<br />
 
<!-- Add links to your Minutes pages by creating the page from the box and adding the name here. -->
 
<br />
 
'''[[Group_1_%E2%80%93_Develop_Guidelines_for_Validation_Rule_Developers_(Mitra) |Group 1 - Develop Guidelines for Validation Rule Developers (Mitra)]]'''
 
<br />
 
'''[[Group_2_%E2%80%93_Assess_and_Improve_Existing_Validation_Rules_(Amy)|Group 2 - Assess and Improve Existing Validation Rules (Amy)]]'''
 
<br />
 
'''[[Group_3_%E2%80%93_Design_Change_Management_Process_(Armando)|Group 3 - Design Change Management Process (Armando)]]'''
 
<br />
 
'''[[Discussion Club: FDA/PhUSE CSS Working Group 1 Update Budapest 2012]]''' <br />
 
<br />
 
<br />
 
== Completed Projects ==
 
<br />
 
#'''[[Guidelines_for_Validation_Rule_Developers|'''Guidelines for Validation Rule Developers - Complete]]'''
 
#'''[[CCB_Study_Data_Validation_Rules_Charter|'''Change Control Board (CCB) for Study Data Validation Rules Charter - Complete]]'''
 
<br />
 
 
 
= How to join =
 
If you are interested in joining a working group 1, follow the instructions below.
 
 
 
#Navigate to https://www.listbox.com/subscribe/
 
#Enter in one of the four groups below:
 
#*WG1-Data-Validation (Working Group 1: Data Validation and Quality Assessment)
 
#Enter your e-mail and click submit. You will then be prompted to enter your First and Last name which is required to participate in the working group 1
 
#You will then receive an e-mail that will provide a link for you to confirm your e-mail (Check those spam folders just in case)
 
#You are now subscribed and should receive information about upcoming meetings from working group co-leaders!
 
 
 
<br />
 
 
 
= Group Meeting Agenda =  
 
 
'''[[May 20 2012 meeting|May 20 2012 Meeting Agenda]]'''
 
'''[[May 20 2012 meeting|May 20 2012 Meeting Agenda]]'''
  
Line 130: Line 91:
 
preload=Template:WG1Minutes
 
preload=Template:WG1Minutes
 
</inputbox>
 
</inputbox>
 
 
<br />
 
<br />
 
<br />
 
 
== Group Discussion ==
 
<br />
 
 
<br />
 
<br />
 +
===Group Discussion ===
 +
'''[[Discussion Club: FDA/PhUSE CSS Working Group 1 Update Budapest 2012]]''' <br />
 
<br />
 
<br />
  
== Group Findings ==
+
=== Group Findings ===
<br />
 
<br />
 
<br />
 
== Group Follow up==
 
<br />
 
 
<br />
 
<br />
 +
=== Group Follow up===
 
<br />
 
<br />
 
  
 
----
 
----
 
If you have questions, please '''[mailto:hany.aboutaleb@biogenidec.com contact WG1 Co-lead]''' .
 
If you have questions, please '''[mailto:hany.aboutaleb@biogenidec.com contact WG1 Co-lead]''' .
  
=Disclaimer=
+
==Disclaimer==
 
FDA comments are an informal communication and represent the individual's best judgment.  These comments do not bind or obligate FDA. The contents of this wiki are from the individual contributors and do not necessarily reflect the view and/or policies of the Food and Drug Administration, the employers of the individuals involved or any of their staff.
 
FDA comments are an informal communication and represent the individual's best judgment.  These comments do not bind or obligate FDA. The contents of this wiki are from the individual contributors and do not necessarily reflect the view and/or policies of the Food and Drug Administration, the employers of the individuals involved or any of their staff.

Latest revision as of 05:44, 5 February 2014


Current Projects


Please follow the links below to view the current project(s):

  1. SDTM Validation Rules Project


NOTE: Bi-weekly meetings will be held Monday 2-3pm starting April 22nd
Email invitations will be sent soon to those subscribed to the Improving Data Quality email list.

To join the team, please contact one of project leads [Mike Molter] or [Majdoub Haloui]

Completed Projects


  1. Group 1 - Develop Guidelines for Validation Rule Developers (Mitra)
  2. Group 2 - Assess and Improve Existing Validation Rules (Amy)
  3. Group 3 - Design Change Management Process (Armando)
  4. Data Sizing Best Practices Recommendation
  5. Top 20 Validation Rule Failures
  6. CAB/VP and OpenCDISC Rules Reconciliation Project
  7. Guidelines for Validation Rule Developers - Complete
  8. Change Control Board (CCB) for Study Data Validation Rules Charter - Complete


Mission

This working group will focus on collaborating to develop a robust process to rapidly validate and assess data quality as data moves through the product life cycle across both industry and regulatory review. The group will discuss current pains and potential solutions around topics such as the current data validation rules as well as the CDISC Data Validation Project, development and implementation of tools, terminology, and improving the quality of the data to support analytical needs.

Background

FDA recently has embarked on an aggressive effort to modernize the review process that will rely on high quality standardized data to streamline acquisition, analysis, storage and reporting. This new process takes a “reviewer-centered” approach where improved data quality, accessibility and predictability will allow reviewers more time to carry out complex analyses, ask in-depth questions and address late-emerging issues. To support the transition to a more advanced review process, FDA has initiated the Data Validation Project. The objective of the project is to evaluate existing validation rules, craft new validation rules, and implement tools to enable systematic, automatic and regular evaluation of data quality and standards conformance at the time of product submission. The project will inform reviewers of characteristics of submitted data, allow for cross-submission assessment of potential problem areas, and help generate a better understanding of several key factors related to data standards adoption, including the rate of uptake of standardized data by sponsors, the degree of adherence to the specified standards, and the ability of reviewers to use standard-specific advanced review methods/tools.

Leadership

Name Role Organization E-mail
Max Kanevsky Industry Co-lead OpenCDISC mkanevsky (at) pinnacle21.net
Hany Aboutaleb Industry Co-lead Biogen Idec hany.aboutaleb (at) biogenidec.com
Doug Warfield FDA Co-lead FDA - CDER Douglas.Warfield (at) fda.hhs.gov
Lisa Lyons Project Manager Janssen llyons3 (at) its.jnj.com
Charles Cooper Steering Committee Liaison FDA - CBER Chuck.Cooper (at) fda.hhs.gov
Anne Russotto Steering Committee Liaison Celgene arussotto (at) celgene.com

Approach

The success of FDA initiatives depends on close collaboration with industry stakeholders including standards development organizations, sponsors, and academia. The approach for this working group is to provide a platform enabling open communication between FDA and industry to share ideas, experiences and expectations, and to facilitate joint development of validation rules and processes to assess data quality and standards compliance throughout the product life cycle.

Scope

The workgroup will initially focus on SDTM Validation Rule project. The purpose of this project is to continue the effort of improving SDTM validation rules, ensuring that all rules are both clear and effective for use by industry and by FDA. The goal is to determine new rules that will add value and manage rules that need clarification. This will involve coordinating with CDISC, OpenCDISC and FDA to propose solutions.

How to join

If you are interested in joining a working group 1, follow the instructions below.

  1. Navigate to https://www.listbox.com/subscribe/
  2. Enter in one of the four groups below:
    • WG1-Data-Validation (Working Group 1: Data Validation and Quality Assessment)
  3. Enter your e-mail and click submit. You will then be prompted to enter your First and Last name which is required to participate in the working group 1
  4. You will then receive an e-mail that will provide a link for you to confirm your e-mail (Check those spam folders just in case)
  5. You are now subscribed and should receive information about upcoming meetings from working group co-leaders!


Meeting Minutes

Data Quality Leadership Team Minutes

Data_Quality_WG_-_15FEB2013
Data_Quality_WG_-_22FEB2013
Data_Quality_WG_-_01MAR2013
Data_Quality_WG_-_08MAR2013



Group Meeting Agenda

May 20 2012 Meeting Agenda



Group Discussion

Discussion Club: FDA/PhUSE CSS Working Group 1 Update Budapest 2012

Group Findings


Group Follow up



If you have questions, please contact WG1 Co-lead .

Disclaimer

FDA comments are an informal communication and represent the individual's best judgment. These comments do not bind or obligate FDA. The contents of this wiki are from the individual contributors and do not necessarily reflect the view and/or policies of the Food and Drug Administration, the employers of the individuals involved or any of their staff.