Scalable data masking protects personal information in large datasets, documents and AI applications – automatically, efficiently and with a focus on data protection.
Companies, public authorities and research institutions are processing ever-increasing volumes of data. Millions of customer records, extensive log files, archived documents and information for AI applications often contain personal or business-critical data. This information must be reliably protected without unnecessarily restricting its further processing and use.
Manual methods and conventional data protection tools quickly reach their limits, particularly in big data applications. Different data formats, distributed storage locations and large data volumes make the systematic detection and masking of sensitive information difficult.
With IRI DarkShield, JET-Software offers a scalable solution for the automated detection, classification and redaction of personally identifiable information (PII) in structured, semi-structured and unstructured data sources.
Automated data redaction protects millions of data records and documents!
Data redaction refers to the targeted obscuring or removal of sensitive information. For example, names, addresses, account numbers or health information are replaced with masking characters or permanently removed from a file intended for distribution.
Unlike the complete deletion of a document, non-confidential content can remain available. This allows information to be used for analysis, research, software development and other business applications, whilst sensitive details are concealed.
The challenge lies particularly in the scale of the task. If, for example, ten million archived customer documents need to be screened for personal data, manual processing is hardly cost-effective.
IRI DarkShield automates these processes and enables the consistent application of defined data protection rules, even to very large datasets.
Automatically detect sensitive data in various file formats!
Personal information is no longer found exclusively in relational databases. It is increasingly found in PDF documents, Word files, Excel spreadsheets, images, log files, as well as JSON, XML, EDI and Parquet files.
IRI DarkShield combines various recognition technologies, including pattern recognition, regular expressions, dictionaries, natural language processing (NLP) and machine learning.
This enables, for example, personal names, identification numbers, medical details or financial information to be located and classified within large datasets.
Based on customisable rules, the recognised content can then be automatically redacted, pseudonymised or protected using other suitable masking methods.
High processing speed through parallel data masking!
When masking large volumes of data, processing speed and scalability play a crucial role.
IRI DarkShield supports parallel search and masking processes and can distribute corresponding tasks across multiple computing nodes. The processing steps can be integrated into existing infrastructures via interfaces and APIs.
This enables organisations to process large datasets more efficiently and make targeted use of existing IT resources.
Processing is possible both in on-premises data centres and in supported cloud and hybrid environments. This makes DarkShield ideal for organisations that need to protect sensitive information across different storage platforms.
Support GDPR-compliant data processing for big data and AI!
The use of large datasets for artificial intelligence, machine learning and business intelligence places particular demands on data protection.
Personal data must not find its way unchecked into training data, analytics platforms or external applications.
IRI DarkShield enables sensitive content to be identified and specifically masked even before it undergoes further processing. In doing so, important structural and contextual characteristics of the data can be preserved, insofar as the chosen protection method permits.
The software thus supports organisations in implementing the General Data Protection Regulation (GDPR), particularly with regard to data minimisation, confidentiality and data protection by design.
Effective anonymisation can reduce the risk of identification, whilst pseudonymised data remains subject to the requirements of the GDPR.
Data masking for the healthcare sector, the financial sector and public authorities!
The potential applications of automated data masking span numerous sectors.
In the healthcare sector, sensitive patient information in medical documents, image files and research data can be protected. Banks and insurance companies can mask personal information in contracts, transaction records and archived documents.
Public sector organisations also benefit from automated redaction processes, for example when large volumes of documents need to be prepared for sharing, publication or internal processing.
Furthermore, DarkShield enables the data-protection-oriented preparation of extensive information sets for AI models, research and analysis.
Integrate automated data protection processes into existing IT landscapes!
Another advantage of IRI DarkShield is the ability to automate recurring search and redaction tasks.
Data protection processes can be planned and integrated into existing workflows via the IRI Workbench graphical development environment, command-line interfaces and APIs.
For example, new documents or data sets can be regularly checked and redacted before being shared, archived or used in analytics and AI systems.
Machine-readable search and redaction logs also support the traceability of the measures carried out.
In conjunction with other IRI technologies such as FieldShield and the Voracity data management platform, organisations can combine data protection functions with data integration, transformation and other processing steps.
Scalable data protection for growing data volumes!
As data volumes increase, so does the importance of automated and centrally controlled data masking.
Organisations need solutions that can identify and protect personal information regardless of data format, storage location and volume.
IRI DarkShield combines intelligent data recognition, rule-based redaction, parallel processing and flexible integration into existing IT systems.
JET Software supports organisations and public sector bodies in implementing appropriate data protection strategies in on-premises, hybrid and cloud-based environments.
The result is more efficient data protection processes, better-protected data assets and greater security when using big data and artificial intelligence!
Efficiency meets experience: For more than four decades, our software solutions have been supporting companies in data management and data protection – technologically leading, reliable in productive use and applicable across all industries.
In use since 1978: Numerous well-known companies, service providers, financial institutions and state and federal authorities are among our long-standing customers.
Maximum compatibility: Our software supports both classic mainframe platforms (Fujitsu BS2000/OSD, IBM z/OS, z/VSE, z/Linux) and modern open system environments such as Linux, UNIX derivatives and Windows.