Data Quality Management Checks in IDEA - Different Ways of Identifying Blank Character Fields

1 post / 0 new
Brian Element's picture
Brian Element
Offline
Joined: 07/11/2012 - 19:57
Data Quality Management Checks in IDEA - Different Ways of Identifying Blank Character Fields

Hello Group Members,

As part of Data Quality Management checks in IDEA, one of the requirements is to capture blank Character fields like say a Blank Narration in a General Ledger or a Blank Address in a Master File.
 
So in this post we look at different ways to capture blank Character fields in IDEA.
 
(a) Direct Extraction
 
Apply a criteria / expression / condition in the Equation Editor as Character Field = ""
 
You can also use @isblank(Character Field)
 
(b) Display All Records Containing
 
Sort on the Character field. All the blanks will come to the top of the field. Right click on any blank and choose Display All Records Containing.
 
This option is a sure shot method of getting your criteria / expression / condition right without having to second guess the syntax as seen in (a) above.
 
As we say ~ let IDEA help you build your criteria through Display All Records Containing.
 
(c) Field Statistics
 
Go to Field Statistics with the active database open on your screen and choose Character as the Field Type (change the selected option from the default Numeric to Character).
 
Now once in Character Field Statistics look at # of Blanks. Click on the count pertaining to the Character Field of your choice, get the records in a fly out windows and then Save As to a separate child file in IDEA
 
(d) Summarization
 
You can also summarize on the Character Field and notice the blank records will come right at the top of the Summarization database. Click on the count and save the displayed records to a separate child file.
 
I am sure there any many other ways of Displaying Blanks in IDEA which you have individually experienced in your journey with IDEA. Just goes to reaffirm the versatility of IDEA.
 
In Monday's post we will look at handling Bad Dates and Inconsistent Date formats in IDEA as part of Data Quality Management checks.
 
Best Regards
 
The Group Admin Team