Difference between revisions of "Top 20 Validation Rule Failures (CBER)"

From PHUSE Wiki
Jump to: navigation, search
m
Line 1: Line 1:
 
{{RightTOC}}
 
{{RightTOC}}
 +
== Purpose ==
 +
 
The purpose of this project is to evaluate the top 20 validation rule failures experienced at CBER. The goals is to determine the cause and coordinate with CDISC, OpenCDISC, and FDA to find and propose a solution. Typically a rule failure is due to any number of the following factors:
 
The purpose of this project is to evaluate the top 20 validation rule failures experienced at CBER. The goals is to determine the cause and coordinate with CDISC, OpenCDISC, and FDA to find and propose a solution. Typically a rule failure is due to any number of the following factors:
 
* Bad or incorrectly implemented rule
 
* Bad or incorrectly implemented rule
 
* Unclear or conflicting underlying standards
 
* Unclear or conflicting underlying standards
 
* Lack of understanding  
 
* Lack of understanding  
<br/>
 
= Discussion Topics =
 
 
* Action Item Updates
 
#  Add date of external communication to Wiki – completed
 
#  Update on progress of change control board for changes to OpenCDISC
 
:* Charter completed
 
:* Request for members due by end of August
 
:* Stand up operational by Sept.
 
  
=Action Items=
+
== Upcoming Meetings ==
*  Review the minutes and add comments, pro/cons to the potential resolutions listed. - ALL
 
  
= General Process =
+
The Top 20 Validation Rule Failures Project team meets every 2 weeks on '''Monday 11-12 am EST'''.<br />
General Steps:
+
To join the team, please contact [[mailto:hany.aboutaleb@biogenidec.com Hany Aboutaleb]] or [[mailto:mkanevsky@pinnacle21.net Max Kanevsky]]
#  Investigate intent of validation rule and what causes it to trigger
 
#  Investigate what is in the IG that informs industry practices
 
#  Assign to a bucket (could be multiple)
 
::* IG Clarification/update
 
::* Rule change or language  clarification
 
::* Guideline from Agency
 
:4. Interface group with  CDISC, OpenCDISC, FDA, CAB Validation project for resolution –the Wiki will have a date of communication to external organization added and we will work within Wiki
 
::* Create Communication Template to document issues, investigation and next steps – no longer needed
 
::* Create tracking spreadsheet (for example Item/Status/Category/Priority) – no longer needed
 
  
 
== SDTM Compliance ==
 
== SDTM Compliance ==
Line 126: Line 109:
 
|}
 
|}
 
<br />
 
<br />
 +
 +
= Discussion Topics =
 +
 +
* Action Item Updates
 +
#  Add date of external communication to Wiki – completed
 +
#  Update on progress of change control board for changes to OpenCDISC
 +
:* Charter completed
 +
:* Request for members due by end of August
 +
:* Stand up operational by Sept.
 +
 +
=Action Items=
 +
*  Review the minutes and add comments, pro/cons to the potential resolutions listed. - ALL
 +
 +
= General Process =
 +
General Steps:
 +
#  Investigate intent of validation rule and what causes it to trigger
 +
#  Investigate what is in the IG that informs industry practices
 +
#  Assign to a bucket (could be multiple)
 +
::* IG Clarification/update
 +
::* Rule change or language  clarification
 +
::* Guideline from Agency
 +
:4.  Interface group with  CDISC, OpenCDISC, FDA, CAB Validation project for resolution –the Wiki will have a date of communication to external organization added and we will work within Wiki
 +
::* Create Communication Template to document issues, investigation and next steps – no longer needed
 +
::* Create tracking spreadsheet (for example Item/Status/Category/Priority) – no longer needed
 +
 +
 
----
 
----
 
'''[[Data Validation and Quality Assessment|Back to Working Group 1: Data Validation and Quality Assessment Homepage]]'''
 
'''[[Data Validation and Quality Assessment|Back to Working Group 1: Data Validation and Quality Assessment Homepage]]'''

Revision as of 12:21, 13 October 2012


Purpose

The purpose of this project is to evaluate the top 20 validation rule failures experienced at CBER. The goals is to determine the cause and coordinate with CDISC, OpenCDISC, and FDA to find and propose a solution. Typically a rule failure is due to any number of the following factors:

  • Bad or incorrectly implemented rule
  • Unclear or conflicting underlying standards
  • Lack of understanding

Upcoming Meetings

The Top 20 Validation Rule Failures Project team meets every 2 weeks on Monday 11-12 am EST.
To join the team, please contact [Hany Aboutaleb] or [Max Kanevsky]

SDTM Compliance

Rule Problem Proposed Solution Status Assignee Date Discussion
SD0002: Null value in variable marked as Required Under Review TBD Comment
SD0006: No baseline result in [Domain] for subject SDTM requires baseline for EG, LB, QS, VS, not all TEST have a baseline Validation rule and standard needs to align with use cases Under Review TBD Jul 30, 2012 Comment
SD0007: Inconsistent value for Standard Units Under Review TBD Comment
SD0026: Missing value for --ORRESU, when --ORRES is provided Not all tets have units Identify tests with no units and update rule implementation Under Review TBD Comment
SD0029: Missing value for --STRESU, when --STRESC is provided
  • Not all tests have units
  • Sponsor doesn’t populate when there are units
  • Need to be able to differentiate between the two
  • Identify tests with no units and update rule implementation
    • Smart check based on list in define or TS of tests that do not have units. Requires TS domain.
    • Alternative, controlled term in that field that indicates no units so don’t have to maintain table. This would impact listings
    • Add list of units and list of tests that have no units to define.xml
    • Add additional variable to the dataset that identifies the test as having no unit – NULL flavor. (this would be a record level not a test level soln.)
  • Propose solutions and determine pro/con of each before proceeding with solution.
Under Review TBD Aug 13, 2012 Comment
SD0031: Missing values for --STDTC and --STRF, when --ENDTC or --ENRF is provided
  • Date collection issue.
  • Con meds for ongoing so have ENRF but no start information.
  • Business rule in IG/FDA explaining how to represent exposures or other events that happen in moments of time.
  • Controlled terminology to represent concepts such as started before trial and is ongoing with no known end date. Cant use this for the date but you need to be able to represent in some variable and then cross check against date field.
  • Check HL7 for this concept to see how they represent or what terminology is used.
  • --STRTPT could be used to represent that the event/intervention occurred prior to. If this solution is selected it would require clarification in the IG
Under Review TBD Aug 13, 2012 Comment
SD0035: Missing value for --DOSU, when --DOSE, --DOSTXT or --DOSTOT is provided Under Review TBD Comment
SD0063: SDTM/dataset variable label mismatch Under Review TBD Comment
SD0070: No Exposure record found for subject
  • Follow on studies, exposure occurred in first study
  • Randomized not treated (high risk trials – subjects die before treatment)
  • Not identified as screen failure
  • Phase 0 study looking at population, no exposure (gene/biomarker), used to select population for exposure
Need to clarify rule Under Review TBD Comment
SD0080: AE start date is after the latest Disposition date
  • May be a partial date issue
  • No disposition date or date is missing
  • May need business rule for example: Followed 30 days post exposure
Need to clarify rule Under Review TBD Comment
SD0081: Observation date is after the latest Disposition date Under Review TBD Comment
SD0087: RFSTDTC is not provided for a randomized subject Under Review TBD Comment
SD0088: RFENDTC is not provided for a randomized subject Under Review TBD Comment

Terminology Compliance

Rule Problem Proposed Solution Status Assignee Date Discussion
CT0027: Value for --OUT not found in (OUT) CT codelist Under Review TBD Comment
CT0037: Value for --BODSYS not found in (SOC) CT codelist Case sensitivity mis-match between CDISC Terminology and MedDRA
  • Confirm CDISC deleted codelist and OpenCDISC will have to rely on MedDRA codelist
  • OpenCDISC will need to removed this Check and activate new check
  • What is the requirement in SDTM for SOC regarding MedDRA versus other dictionaries?
  • Need to tie pieces together
Under Review TBD Aug 13, 2012 Comment

Define.xml Compliance

Rule Problem Proposed Solution Status Assignee Date Discussion
DD0010: ODM attribute should not be included in Define.xml Likely a lack of understanding by the users Need to clarify CDISC documentation and rule Under Review TBD Jul 30, 2012 Comment
DD0024: Invalid Codelist for variable Effects non-extensible codelists in legacy studies Clarify CDISC documentation Under Review TBD Aug 13, 2012 Comment

Other

Rule Problem Proposed Solution Status Assignee Date Discussion
SKIP_xxnnnn: SKIP messages Indicate that a domain (ex: DM) is missing and cannot be used for cross-dataset validation This is extraneous information and should be hidden from the user Under Review OpenCDISC Jul 30, 2012 N/A


Discussion Topics

  • Action Item Updates
  1. Add date of external communication to Wiki – completed
  2. Update on progress of change control board for changes to OpenCDISC
  • Charter completed
  • Request for members due by end of August
  • Stand up operational by Sept.

Action Items

  • Review the minutes and add comments, pro/cons to the potential resolutions listed. - ALL

General Process

General Steps:

  1. Investigate intent of validation rule and what causes it to trigger
  2. Investigate what is in the IG that informs industry practices
  3. Assign to a bucket (could be multiple)
  • IG Clarification/update
  • Rule change or language clarification
  • Guideline from Agency
4. Interface group with CDISC, OpenCDISC, FDA, CAB Validation project for resolution –the Wiki will have a date of communication to external organization added and we will work within Wiki
  • Create Communication Template to document issues, investigation and next steps – no longer needed
  • Create tracking spreadsheet (for example Item/Status/Category/Priority) – no longer needed



Back to Working Group 1: Data Validation and Quality Assessment Homepage


Last revision by Mkanevsky on 10/13/2012