May 21, 2024 · 12:12 PM

Microsoft 365 eDiscovery Throttling is Structural and Won’t Be Going Away

By Chas Meier

Users of Microsoft 365 for eDiscovery and Information Governance continue to encounter significant problems with low throughput and defensibility. Many customers report to us that Purview eDiscovery Premium’s documented limitations, including a 2GB per hour indexing limit, prevent them from using the platform to handle anything other than small matters. A routine eDiscovery matter involving one hundred custodians each with about 10GB of M365 data typically requires several weeks to complete with MS Purview Premium. This is a non-starter for legal teams who are up against pressing litigation timelines.

It is important to understand that because M365 is built on a large-scale multi-tenancy SaaS architecture, such challenges are a feature, not a bug of the system. Multi-tenancy is an architecture where shared computing resources are apportioned across large numbers of users. This architecture enables Microsoft to provide the service at a lower cost since computing services are shared.

However, multi-tenant architecture enables scale (in terms of multitudes of users) and efficiency through uniformity. These architectures are not designed for outlier workloads like eDiscovery that routinely require intensive surges in computing resources to collect, process and search terabytes of data. In fact, multi-tenancy cloud architects would identify eDiscovery workloads as a “noisy neighbor” that threatens the overall performance and user experience of the system, and thus must be managed through quality-of-service mechanisms like throttling and time-outs.

I think of multi-tenant architectures like the business model utilized by a gym. The gym has more and better equipment than I have at home, which is attractive so many will join through a membership. The gym has a fixed amount of square footage and equipment which is more than any individual needs and is sufficient to support those that show up, occasionally having to coordinate access to the equipment but manageable. However, what if a small group showed up at the gym every day for most of the day and hogged the equipment? What if more people showed up, became frustrated, and dissatisfied? Gym management would be forced to act to ensure fair access to the equipment.

Throughout my career as an eDiscovery service provider, we made large investments in infrastructure and capacity to the point of overkill to equip ourselves to service a client’s need to address high volumes of data in short timelines without impacting their business-as-usual activities. We were like the fire department for big unstructured data needs.

A huge differentiator in X1’s approach is to divide and conquer large scale projects by leveraging the cumulative power of a decentralized computing orchestrated through a unified management, search, and collection console. Think of this like deploying a fire suppression system proactively before the fire.

Last year, X1 introduced M365 data connectors into our X1 Enterprise platform to satisfy a critical need for enterprises to conduct cost-efficient yet highly scalable eDiscovery search and collection of M365 data. The response has been tremendous, with X1 seeing record demand in large part, due to the architectural limitations and deficiencies noted above.

X1 Enterprise Collect provides users the unique ability to index and search M365 data in-place and then collect in a targeted and iterative manner. This at speeds and throughput far exceeding other tools, including Microsoft Purview Premium. X1 achieves such scalability through a decentralized custodian-based approach that does not rely on the M365 or Purview search Index, which has known issues with the number of file types supported, consistency of search results, and throughput. X1’s approach enables a very scalable, defensible, and robust data collection at speeds far exceeding that of M365 Purview and other approaches.

For a demonstration of the X1 Enterprise Collect Platform, contact us at sales@x1.com. For more details on this innovative solution, please visit www.x1.com/solutions/x1-enterprise-platform.

Leave a comment

Filed under Best Practices, Cloud Data, Corporations, eDiscovery, eDiscovery & Compliance, Enterprise eDiscovery, ESI, Information Governance, Preservation & Collection

Tagged as , , , , , , ,

May 7, 2024 · 9:28 AM

Index and Search In-Place Workflows Are Essential for Information Governance

By John Patzakis and Charles Meier

Information Governance

Accurate pre-collection data insight is a game-changing capability that enables organizations and their legal teams to determine the scope, volume, and content of electronic information before the very disruptive and expensive step of collecting the data. This insight is enabled through distributed index and search in-place technology.

A true distributed index and search in-place capability for unstructured data requires a software-based indexing technology be deployed directly onto fileservers, laptops, or in the cloud to address Microsoft 365 and other cloud-based data sources. This indexing occurs where the data sources reside without requiring a bulk transfer of the data to a central location. Once indexed, searches can be performed in seconds, supporting complex Boolean operators, metadata filters and regular expressions. Searches can be iterated and refined without limitation, which is critical for large data sets.

While our previous blog post addressed the critical importance of this capability in eDiscovery matters, it is equally essential in information governance projects such as PII audits, the purging of redundant, obsolete or trivial (ROT) data, and due diligence and data separation efforts in support of corporate mergers and acquisitions. Many X1 customers have recently employed our indexing in-place technology on such projects with remarkable success.

Incredibly, many of these customers also received alternative proposals that leverage traditional eDiscovery workflows presenting much higher estimated costs and much longer durations. Traditional eDiscovery workflows mandate broad and manual data collection, copying and migration efforts, large scale data processing, and loading the data into a different platform for review and analysis. There are three fundamental reasons why this “traditional approach” is fatally flawed for information governance projects.

  1. Prohibitive Cost and Risk. The data scope of information governance projects involves terabytes and sometimes petabytes of data. Mass collection, copying and migration of these data sets with manual hand-offs for later analysis in a centralized location is extremely expensive, disruptive, and time consuming. Also, mass duplication and egress of enterprise data under control to execute ROT, PII, data separation or other due diligence projects is completely antithetical to their very purpose.
  2. The “Now What?” Problem. Let’s assume an organization has decided to incur the enormous cost, disruption and risk associated with the mass copying, migration, and centralization of unstructured data, and after loading the data into a review process, a key subset of documents and emails are finally identified for purging or other remedial action. Now what? You are merely working with copies! The live “original” emails and documents are in M365, email accounts, file servers or on laptops. It is possible to manually retrace and remediate, but that process is expensive and disruptive.
  3. Instant Staleness. Finally, a mass copying and migration effort often requiring several weeks to complete, is immediately stale once eventually completed as the live data in its original location has inevitably changed.

X1 solves these challenges though our proprietary and patented distributed index and search in-place technology that enables scale by bringing true distributed indexing in-place to laptops, file shares, M365 and other cloud sources. X1 Enterprise Collect significantly streamlines information governance workflows by identifying and allowing for the remediation of targeted data in-place, thereby eliminating the need for expensive and cumbersome data duplication and migration.

For a demonstration of the X1 Enterprise Collect Platform, contact us at sales@x1.com. For more details on this innovative solution, please visit www.x1.com/x1-enterprise-collect-platform.

Leave a comment

Filed under Cloud Data, compliance, Corporations, eDiscovery, eDiscovery & Compliance, Enterprise eDiscovery, ESI, Information Governance, law firm, Preservation & Collection

Tagged as , , , , , , , , ,

April 23, 2024 · 10:04 AM

Index-In-Place eDiscovery Tech is in High Demand, but Beware of False Vendor Claims

By John Patzakis

Proportionality-based eDiscovery is a goal that all in-house corporate legal teams want to attain. Under Federal Rule of Civil Procedure 26(b)(1), parties may discover any non-privileged material that is relevant to any party’s claim or defense and proportional to the needs of the case. However, most core eDiscovery costs (outside of attorney review) stem from over-collection of electronically stored information (ESI), and over-collection thwarts the ability to attain proportionality. Law firm Nelson Mullins notes that “over preservation tends to have its own costs relating to storage of large amounts of electronically stored information (ESI) and the resources needed to manage it; leads to increased downstream e-discovery costs associated with collection, processing, and review.”

This is why accurate pre-collection data insight is a game-changing capability that enables counsel to set reasonable discovery limits and ultimately process, host, review and produce much less ESI. Counsel can further use pre-collection proportionality analysis to gather key information, develop a litigation budget, and better manage litigation deadlines. Such insights can also foster cooperation by informing the parties early in the process about where relevant ESI is located, and what keywords and other search parameters can identify and pinpoint relevant ESI.

And the means to enable this capability is distributed index and search in-place technology. Indexing and search in-place in this context means that a software-based indexing technology is deployed directly onto fileservers, laptops, or in the cloud to address cloud-based data sources. This indexing occurs without a bulk transfer of the data to a central location. Once indexed, the searches are performed in a few seconds, with complex Boolean operators, metadata filters and regular expression searches. The searches can be iterated and repeated without limitation, which is critical for large data sets.

However, with this capability being highly valued, many vendors have parroted this messaging, but have offerings that do not qualify as true index-in-place. True distributed index-in-place means that the search indexes are forward-deployed, and are actually installed on the target laptop, Mac computer, fileserver or into the cloud near where the target cloud data sources exist. Transferring data in bulk to a central appliance or server farm via a collector agent or Robocopy function does not qualify. A true index-in-place capability uniquely enables scalability, targeted collection and also minimizes security and data governance risks in eDiscovery and information governance matters.

Conversely, a process requiring massive data copying, migration and centralization does not scale and creates significant data, governance and privacy issues by needlessly duplicating data. For instance, if a matter requires that 10 terabytes be scanned to determine if relevant ESI exists within that data corpus, and the eDiscovery collection platform being used has no index-in-place capability, then all 10 terabytes must be copied and transferred to the tool for indexing and analysis. These limitations stem from tool vendors simply utilizing open source indexing platforms like Lucene or Elastic Search that are not forward-deployable and must reside in centralized locations with a very large amount of computing resources to make them viable for the type of data and data volumes typically seen in discovery and information governance matters.

This is why X1 leverages proprietary and patented index and search technology that is readily forward deployable and thus can scale and allow true distributed indexing in-place. X1 Enterprise Collect significantly streamlines the eDiscovery workflow with integrated culling and deduplication, thereby eliminating the need for expensive and cumbersome ESI processing tools. That way, the ESI can be populated straight into Relativity from an X1 collection without multiple hand offs, extensive project management and inefficient data processing.

The ability to directly and transparently collect data from custodian laptops, desktops, Microsoft 365 and other cloud sources into a RelativityOne/Relativity workspace is a game-changer that enables attorneys to begin review in hours rather than weeks.

For a demonstration of the X1 Enterprise Collect Platform, contact us at sales@x1.com. For more details on this innovative solution, please visit www.x1.com/x1-enterprise-collect-platform.

Leave a comment

Filed under Best Practices, Cloud Data, Corporations, ECA, eDiscovery, Enterprise eDiscovery, ESI, law firm, Preservation & Collection, proportionality

Tagged as , , , , , , , , ,

April 9, 2024 · 10:53 AM

New X1 Search 9 Provides the Best Means to Search Your Microsoft 365 Data Sources

By John Patzakis and Chas Meier

Last week X1 announced major new, robust features to our desktop productivity solution X1 Search. The next generation of X1 Search is no longer desktop-only focused, but instead provides a revolutionary ability to instantly search across your Microsoft email, Teams, OneDrive, SharePoint as well as your local files and email all in a single unified search. This powerful capability supercharges your productivity, thereby saving hours a day. This added support also extends to Google Drive and Gmail.

While there are many innovations with X1 Search 9, the ability to search across all your M365 data sources with a single search is particularly game changing. No other enterprise or desktop search solution can match this functionality. The native Microsoft M365 search has a semblance of this, offering only a few search results displayed with a cursory preview, as opposed to full search results and full fidelity preview provided by X1.

“X1 Search is my go-to, must-have search application on my desktop,” said Max Underwood, long-time business and personal user from a large defense contracting firm. “Nothing even comes close to matching X1 Search’s speed and accuracy in finding what I am looking for exactly when I need it so I can get back to work, whether the source file is located on my local drive or hosted on a distant cloud via my company’s network. It’s an incredible time-saver, invaluable, way ahead of Windows Search or any other search tool I’ve seen – literally saving me hours each work week. X1 Search is essential to my day-to-day operations, and with the new ability to instantly search across all my Teams messages and accelerate my Gmail search on top of the current capabilities, the solution is even more compelling.”

No other solution enables you to instantly search across all your core data applications using a single prompt and return immediate results with hit highlighting and full fidelity preview capabilities. X1 Search unlocks the ability to find information no matter where it resides whether it’s lost in your spam folder, archived in your email 10 years ago, buried in a Teams chat or recently added to your OneDrive or SharePoint. X1 Search does the work for you, faster and far better than any other desktop or enterprise search offering.

The new X1 Search version 9 capabilities, include the following benefits:

• The ability to search through all your Microsoft Teams Chats and Channels history, including messages, attachments, emojis, reactions, and more, all from a single interface.
• Elevate your cloud data search capabilities with the new Google drive connector enabling you to search your complete Google drive history and immediately perform Post Search Actions.
• Index, search and find information in your Gmail 3 times faster with the new API-based Gmail connector.
• Patented fast-as-you-type search with built-in hit highlighting and full fidelity preview for immediate visibility into your results.
• Search across all your Outlook email, attachments, Outlook calendar, and contacts list via X1’s deep Outlook integration.
• Unified search across all your data sources to instantly search and find emails, attachments, documents, local files, and M365 data in a single search.
• Accelerate your email workflow with M365 Archived mail search capabilities – Rapidly index years’ worth of archived Outlook email in half the time.

X1 will be hosting a webinar on Wednesday, April 17 introducing the game-changing, new solution capabilities now available with X1 Search version 9.

The X1 Search solution is available for individual purchase on the X1 website and large volume, enterprise purchase by contacting X1 at sales@x1.com. To learn more about X1 Search visit www.x1.com/products/x1-search

Leave a comment

Filed under Best Practices, Business Productivity Search, Corporations, Desktop Search, Enterprise Search, ESI, Hybrid Search, Information Management, MS Teams, OneDrive, productivity, Records Management, SharePoint, X1 Search 9

Tagged as , , , , , , , ,

March 13, 2024 · 2:06 PM

Microsoft 365 Modern Attachments Pose Significant eDiscovery Challenges and Risk

By John Patzakis

In their excellent publication, 2023 eDiscovery Case Law in Review, Winston and Strawn, LLP, one of the top law firms in the US, highlights the challenges legal and eDiscovery professionals face with modern attachments. Modern attachments, also known as hyperlinks, are URL pointers that link to files or emails stored in another location. They are commonly found in Microsoft 365 Mail and Teams.

Winston and Strawn reports that “[r]equesting parties are increasingly sophisticated about this issue given the proliferation of Microsoft 365…and thus we have noted an uptick in requesting parties demanding that linked attachments be produced along with transmittal emails—in essence demanding that traditional email families be assembled from these pieces.” In re StubHub Refund Litig., 2023 WL 3092972 (N.D. Cal. April 25, 2023) is a case cited by the authors as a recent decision requiring the production of modern attachments in discovery.

The one area I disagree with in the report is its view that without investing in expensive services and Microsoft Premium licensing it may be very challenging and burdensome to identify and collect modern attachments. If you rely on Microsoft Purview for eDiscovery compliance and information governance, you must upgrade to expensive premium licensing that can add up to tens of millions of dollars in additional expense for larger enterprises. And even then, there are significant throughput and defensibility challenges.

eDiscovery service providers have stepped into the mix to provide manual services to address MS 365 challenges. But throwing services at the problem is disruptive, inefficient, and expensive as well.

X1 provides a different approach. X1 Enterprise Collect provides full support for modern attachments in MS Mail and in Teams. X1 is the only solution we and our partners are aware of that supports the search and collection of modern attachments in MS 365 without the need for a Premium (E5) license or additional manual services. This is because X1 Enterprise Collect does not operate by simply making bulk calls to the MS Graph API, like most eDiscovery tools, which also require a premium license to collect the key data such as modern attachments. X1 employs a targeted, custodian-based approach that minimizes 365 API calls, and does not rely on the MS Search Index, which has been demonstrated to be untrustworthy and with limited throughput. X1’s approach enables a very scalable, defensible, and robust data collection at speeds 10x that of other approaches.

The X1 Enterprise Collect Platform is available now from X1 and its global channel network in the cloud and on-premise. For a demonstration of the X1 Enterprise Collect Platform, contact us at sales@x1.com. For more details on this innovative solution, please visit www.x1.com/x1-enterprise-collect-platform.

Leave a comment

Filed under Best Practices, Case Law, Cloud Data, Corporations, eDiscovery, Enterprise eDiscovery, ESI, law firm, MS Teams, OneDrive

Tagged as , , , ,