| | December 20178CIOReviewEnterprises need to become more lean and efficient to stay in business. As a result, Enterprise Data Management is gaining more attention. In my position, I promote treating data as an asset through non-invasive data governance, better data quality, and a holistic approach to data management for the entire corporation. Application optimization is not by itself sufficient to enhance the performance of an organization. As data flows between and through applications, high data quality in searchable structures is also essential to optimizing an organization. Code alone cannot fix bad data; in fact, data quality issues can generate inefficient code which constantly checks for infrequent or rare conditions.Simultaneously, good quality data in optimized structures cannot overcome bad, redundant, or inefficient applications or processes. Inaccurate data, and even lack of knowledge about the data creates inefficient environments with data duplication and possibly hoarding. If data issues are not corrected at the source, then multiple downstream applications must also create code to fix in place, which is redundant, possibly creating different results.Data architects create patterns with datastorage patterns, structure patterns, usage patterns, naming standards, data flows, etc. These patterns can then be used by the `data lake librarians' to create search patterns, retrieval patterns (standardized exports, for example), and patterns to feed external structures like reports and visualizations.Librarians are the closest thing to what Data stewards should be--they are dedicated, trained to organize using patterns, search using catalogs, and can handle multiple media types. 80 percent of data lake searches should be pattern-based, or attribute-based, and easy for anyone to use. The other 20 percent may require skills or more complex patterns.Data Lake as a LibraryA data lake is essentially a library, ideally staffed with experienced employees who can handle and find data in multiple formats. Making data findable includes having a comprehensive data/metadata By Susan Earley, Data Jedi, Sears Holdings Corporation [NASDAQ:SHLD]DATA LAKE LIBRARIANSIN MY OPINION
<
Page 7 |
Page 9 >