This document provides best practices for supervising a large-scale electronic document review when the review must be delegated to other attorneys. It recommends creating a thorough review protocol that provides background on the case, key players, coding instructions, and responsive and privilege criteria. It also suggests conducting a pre-review, setting up the review platform with the database manager, maintaining consistency during the review through daily logs and quality control checks, and maintaining records of review decisions for defensibility.
Reports ExpectationsAll reportspapers should have a cover page.docxaudeleypearl
Reports Expectations:
All reports/papers should have a cover page, an abstract, a table of contents that is automatically generated in Word, and an introduction, identifiable sections of your paper, and conclusion.
Since this is graduate level work, I expect a substantial amount of citations in your writing. Include appropriate reference citations for any content used in the body of your Project.
Review and Use American Psychological Association (APA) format for citations, Figure labels, and Tables, etc.
Label all screen shots using APA format (e.g. Figure 1 , FTK Evidence Processing) (e.g. Table 1 Budget Projections, etc. )
Please refer to the resource on writing graduate level papers which is part of the library resources.
All submissions have to be in Word so I can embed my feedback within the document - no pdf.
For re-submission, please work from the document in which my feedback was embedded, and please leave the feedback intact – that way I can tell where changes have been made to the re-submission.
Please adhere to expected paper length in your papers.
I ask that you read the project specifications carefully and identify what is required. For example, Project One requires that you develop the necessary steps to set up a forensics investigation plan. The plan should therefore include the following:
A brief abstract of what the paper is about
An introduction to the case at hand
A checklist description of safety steps an investigator would follow to ensure safety is addressed in the investigation
The Preliminary Work will discuss the Rules and Regulation, and Laws pertaining to your investigation. This could include key components such as chain of custody for evidence file examination, search warrant, subpoenas, jurisdictions, plain view doctrine, authority, etc…
A description of Preparation / Interview Questions by providing the forms you will use such as interview questions, chain of custody form.
A description of Investigation Resources including a check list of resources to be considered, tool & equipment, analysis of evidence types and contingencies
A description of Management Plan when you discuss your proposed methodology. This methodology would include at least the discussion of collection, examination, analysis, and reporting.
The methodology will:
help avoid general legal liability and avoid liability to third parties interested in the investigation, e.g., intellectual property rights, etc. You also need to minimize the potential for becoming trapped in legal issues and include third parties with interest in the investigation.
Ensure the safety of the property and environments involved in the investigation.
Provide the evidence-handling procedures that are preserving the chain of custody, and are critical if law enforcement becomes involved.
The Management Plan should also describe the team structure, budget and timeline. Use Proper Budget Projection Table and Label (See APA format); Use Proper Timeline Table and Label (See ...
Document review, in the context of litigation and legal proceedings, is the process by which each party to the proceeding examines, sorts, and analyses all documents, data, and electronic information in their possession to determine which materials are relevant to the proceeding and which should be withheld from production. Most discovery and ediscovery actions are built around this procedure.
Critical Roadblocks In The Review Of Litigation DocumentsAbsolaw
ABSOLaw offers top-notch legal document review services, ensuring meticulous scrutiny of contracts, agreements, and other legal materials. Our team of experienced attorneys delivers thorough analyses, identifying potential risks and highlighting critical details, providing you with peace of mind and legal confidence. Visit our website for professional assistance.
Reports ExpectationsAll reportspapers should have a cover page.docxaudeleypearl
Reports Expectations:
All reports/papers should have a cover page, an abstract, a table of contents that is automatically generated in Word, and an introduction, identifiable sections of your paper, and conclusion.
Since this is graduate level work, I expect a substantial amount of citations in your writing. Include appropriate reference citations for any content used in the body of your Project.
Review and Use American Psychological Association (APA) format for citations, Figure labels, and Tables, etc.
Label all screen shots using APA format (e.g. Figure 1 , FTK Evidence Processing) (e.g. Table 1 Budget Projections, etc. )
Please refer to the resource on writing graduate level papers which is part of the library resources.
All submissions have to be in Word so I can embed my feedback within the document - no pdf.
For re-submission, please work from the document in which my feedback was embedded, and please leave the feedback intact – that way I can tell where changes have been made to the re-submission.
Please adhere to expected paper length in your papers.
I ask that you read the project specifications carefully and identify what is required. For example, Project One requires that you develop the necessary steps to set up a forensics investigation plan. The plan should therefore include the following:
A brief abstract of what the paper is about
An introduction to the case at hand
A checklist description of safety steps an investigator would follow to ensure safety is addressed in the investigation
The Preliminary Work will discuss the Rules and Regulation, and Laws pertaining to your investigation. This could include key components such as chain of custody for evidence file examination, search warrant, subpoenas, jurisdictions, plain view doctrine, authority, etc…
A description of Preparation / Interview Questions by providing the forms you will use such as interview questions, chain of custody form.
A description of Investigation Resources including a check list of resources to be considered, tool & equipment, analysis of evidence types and contingencies
A description of Management Plan when you discuss your proposed methodology. This methodology would include at least the discussion of collection, examination, analysis, and reporting.
The methodology will:
help avoid general legal liability and avoid liability to third parties interested in the investigation, e.g., intellectual property rights, etc. You also need to minimize the potential for becoming trapped in legal issues and include third parties with interest in the investigation.
Ensure the safety of the property and environments involved in the investigation.
Provide the evidence-handling procedures that are preserving the chain of custody, and are critical if law enforcement becomes involved.
The Management Plan should also describe the team structure, budget and timeline. Use Proper Budget Projection Table and Label (See APA format); Use Proper Timeline Table and Label (See ...
Document review, in the context of litigation and legal proceedings, is the process by which each party to the proceeding examines, sorts, and analyses all documents, data, and electronic information in their possession to determine which materials are relevant to the proceeding and which should be withheld from production. Most discovery and ediscovery actions are built around this procedure.
Critical Roadblocks In The Review Of Litigation DocumentsAbsolaw
ABSOLaw offers top-notch legal document review services, ensuring meticulous scrutiny of contracts, agreements, and other legal materials. Our team of experienced attorneys delivers thorough analyses, identifying potential risks and highlighting critical details, providing you with peace of mind and legal confidence. Visit our website for professional assistance.
3 Best Practices for eDiscovery Custodian InterviewsD4
With all the advanced technologies available to us, a good client interview still provides the single biggest advantage in saving money and managing the risks of eDiscovery. Besides getting a good idea about the facts of your case and the value of potential witnesses, a good client interview helps to achieve a cost-effective review and a proportionate discovery response.
While eDiscovery service providers stress the importance of consistency – every case, IT environment, and custodian is different making it difficult to leverage templates and repeatable workflow for the interview process.
When done properly and thoroughly, custodian interviews will arm you with the proper information to negotiate a reasonable scope of discovery. Nailing an eDiscovery interview means insuring that you focus on the case, verify the facts, and document the process.
Final Assignment for CRJ302 –Criminal Procedure Due 11.docxcharlottej5
Final Assignment for CRJ302 –Criminal Procedure
Due: 11:59 p.m. (Eastern Time) Saturday of Unit 8.
This course is designed to expose you to the process in which law enforcement
investigates crimes, builds cases, collects evidence, and how it affects arrests of
individuals. It also presents the court process and prosecution of the individuals charged
with the violation of law. The knowledge you will gain and the research you will
undertake, should yield a final project in which you can conduct a technical analysis and
discussion of the mechanics of a criminal case and prosecution.
The final product will be an APA formatted paper that is a minimum of five pages and no
more than 20 (not including the cover & reference pages). The final submission must
include:
• APA formatted title page
• Body of paper, and
• Reference page
Synopsis:
There are a three graded phases which will impact your project and final grade. Stated
simply, this project will consist of a case study and analysis of a criminal case of your
choice. The case study focuses on the investigative efforts, actions and procedures
undertaken by law enforcement while building a case against a defendant. For example,
look at the court testimony of the State Trooper who arrested the Oklahoma City
bomber.
If this were your case, (which it cannot be), you would outline all of the steps taken by
the Trooper from the time of the motor vehicle stop until McVeigh was taken into
custody and including the additional steps taken by the FBI in lawfully searching the
vehicle. All of the actions in this case can be supported by acceptable criminal
procedures prescribed by state and federal laws. The intent of this project is for you, to
analyze, compare and either support the steps taken or else identify those actions
which could be considered illegal. This course will provide you with the methods,
concepts and case law to be utilized as a basis for such evaluation and application.
During Unit 2, you will be required to submit a criminal case you wish to utilize as your
final project. You must however, provide a case report , court documentation or some
other type of proof to confirm that your case study is actually based on a real case,
which will provide a road map for your analysis. Remember, this type of assignment will
require research, thought, analysis and the application of the material we will cover in
this course. You will be required to submit a five (5) page minimum (standard size) and
a twenty (20) page maximum APA formatted paper using APA citation to
acknowledge all source materials.
You should review the grading rubric before beginning the project, while writing the
document and upon completion to ensure you have covered all that is required in your
final draft. In Unit 6 you will be called upon to conduct a peer review of another
classmates’ project.
http://law2.umkc.edu/faculty/projects/ftrials/mcveigh/mcveigharrest.html
http:/.
The fieldwork phase is the heart of the audit process. Everything auditors do in the planning phase drives them to do the right things in fieldwork. Everything auditors do in the reporting phase relates to what was found in fieldwork. Everything auditors do in the follow-up phase relates to the issues identified in fieldwork. This webinar will focus on the testing for control effectiveness. This includes capturing the best audit evidence and documenting quality work in the workpapers. This helps ensure that any competent third party person can re-perform the work and come to the same conclusion.
This webinar is for auditors who want to understand the key elements of the fieldwork phase of the audit process.
The learning objectives include the following:
- Learn about internal control terminology
- Learn about testing techniques and workpaper quality
- Learn about audit evidence
- Learn about workpaper documentation guidelines
Learn about Issues & Recommendations (I&Rs)
Brian HughesTheimportanceof evidencecollectionan.docxjasoninnes20
Brian Hughes
The
importance
of evidence
collection
and preser-
vation
can be
overpowered
by other
priorities.
Incident Investigation:
Evidence Preservation
Looking back at your last incident investiga-tion, did you experience anything similiar orwere you faced with any of these dilemmas?
•While attending to the needs of injured and dis-
tressed employees, time-sensitive evidence was
missed.
• While securing the area and bringing it back to
a safe mode, circumstances that could have served
as evidence had to be altered.
•In the bustle to minimize costly downtime,
resuming production rushed the evidence collec-
tion process.
• A piece of critical evidence
disappeared.
•The legal department
wished it had more to demon-
strate due diligence.
•A regulatory body's
requirement or request could
not be fulfilled.
In tlie rush to return to a
state that resembles normalcy,
the importance of evidence
collection and preservation
can be overlooked or over-
powered by other priorities.
Evidence is critical to any incident investigation
because it is the data that support the conclusions
of the investigation. The primary intent of an inci-
dent investigation is to identify effective solutions.
To accomplish this, the investigation needs to
uncover causes and how they relate to one another.
Evidence provides support for what the team con-
cludes to be causes, it cultivates a level of confi-
dence that correlates directly to the quality of the
evidence collected. Evidence is the foimdation for
an investigation—for the investigation team as well
as for others reviewing fuhue investigation results
and conclusions.
Many companies do not have a formal evidence
preservation policy in place, so the process is ad
hoc—left up to the investigator or individuals on
the team. Some highly regulated companies, with
the nature of their governing regulations, specify
requirements for evidence documentation. They
tailor their evidence preservation policy to match
the requirements of the regulatory agency. But evi-
dence documentation is not necessarily the same as
evidence collection or preservation. Regulatory
requirements must be considered. However, a poli-
cy can be developed that fulfills the objectives of
the investigation and the requirements of regulato-
ry agencies.
It is best to decide how to handle evidence
before an emergency occurs. Develop an evidence
preservation policy based on the organization's
needs and distribute it to everyone who will have
the responsibility to carry it out. Include it in train-
ing curriculum so pc\iple are familiar with the
process before they actually need it.
What follows are guidelines that any company
can use to develop a simple evidence preservation
policy to help ensure that evidence is managed
effectively throughout an investigation.
Step 1: Assess the Significance
Ask a few simple questions to dtxument the
actual and potential significance of the problem.
Try not to overreact to a rela-
tively benign problem ...
How to carry on multiple projects in medical writing - PubricaPubrica
Medical writing services entails developing well-structured factual publications such as clinical research papers, material for healthcare blogs, newsletters, newspapers, and news. Regulatory medical writing and Educational medical writing are the two forms of medical writing.
Continue Reading: https://bit.ly/3u3j9na
Reference: https://pubrica.com/services/physician-writing-services/
Why Pubrica:
When you order our services, We promise you the following – Plagiarism free | always on Time | 24*7 customer support | Written to international Standard | Unlimited Revisions support | Medical writing Expert | Publication Support | Biostatistical experts | High-quality Subject Matter Experts.
Contact us :
Web: https://pubrica.com/
Blog: https://pubrica.com/academy/
Email: sales@pubrica.com
WhatsApp : +91 9884350006
United Kingdom: +44- 74248 10299
How to carry on multiple projects in medical writing - Pubrica
raineygauntformal707
1. Reproduced with permission from The United States Law Week, 84 U.S.L.W. 22, 7/7/15. Copyright 2015 by The
Bureau of National Affairs, Inc. (800-372-1033) http://www.bna.com
E v i d e n c e
O f fi c i a l D o c u m e n t s
What should litigators do when they need to delegate a case’s large-scale document
review? Hunton & Williams attorneys Dionne Rainey and Kevin E. Gaunt outline how the
supervising attorney can make the process run efficiently. Among other things, they sug-
gest creating review protocols, including making sure the reviewers know the codes to be
used and how to spot confidential documents. They also suggest implementing quality con-
trols.
Best Practices for Supervising a Large-Scale Electronic Document Review
BY DIONNE RAINEY AND KEVIN E. GAUNT
I
f you are a litigator, you have almost certainly spent
time reviewing documents for production in a case.
Attorneys working on a case typically have a handle
on the subject matter, the key players, and the central
documents, so the document review process is merely
an extension of the attorney’s involvement with the liti-
gation. When conducting a review yourself, there is
usually little need for a formal review protocol.
However, in some cases, it is necessary to delegate
document review to other attorneys, either because of
the sheer volume of documents to review, and the time
it will take to review them, or due to financial con-
straints. For those cases, an attorney will take on the
additional responsibility of supervising reviewers who
are not familiar with the case. There are ways to make
this process runs smoothly and efficiently, and to en-
sure that the reviewers have properly and consistently
coded the reviewed documents. The following best
practices will ensure that your review is not only defen-
sible if it is ever challenged in a discovery dispute, but
run in a cost effective manner.
Before Review
Before the document review begins, you need to do
some legwork to set yourself up for success. Here are a
few steps you should take before beginning the review.
Creation of Review Protocol
The review protocol is a comprehensive document
given to the reviewers that should provide clear and
thorough guidance up front regarding the document re-
view. If you do not provide proper instructions at the
outset, you will end up correcting or changing the in-
structions mid-stream, causing a substantial amount of
re-review and QC steps that can increase your time
Dionne Rainey is a partner with Hunton &
Williams LLP’s commercial litigation
team and the head of the firm’s information
governance & e-discovery group. Kevin Gaunt
is an associate in the commercial litigation
practice. They can be reached at dcrainey@
hunton.com and kgaunt@hunton.com.
This article presents the views of the authors
and does not necessarily reflect those of
Hunton & Williams or its clients. The informa-
tion presented is for general information and
education purposes. No legal advice is
intended to be conveyed; readers should con-
sult with legal counsel with respect to any
legal advice they require related to the subject
matter of the article.
COPYRIGHT 2015 BY THE BUREAU OF NATIONAL AFFAIRS, INC. ISSN 0148-8139
The United States
Law Week
Case Alert & Legal News™
2. frame and costs. A good review protocol typically in-
cludes the following items:
s Background – Provide the review team with a
thorough history of the case, facts and procedural
posture so that reviewers have context for the docu-
ments that they will be reviewing.
ࡗ It is helpful to give the reviewers some in-
sight into how the documents were collected and
from whom. For instance, if the parties agreed
upon the search terms that were used to collect
documents from the client, there may be a pre-
sumption that many documents are going to be re-
sponsive; on the other hand, if the collection con-
sisted of everything on a custodian’s hard drive,
then the relevance analysis may be more difficult.
ࡗ Similarly, provide the reviewers an explana-
tion of whether any sort of predictive coding or
other technology-assisted review techniques were
used to collect the review documents. The more
context you can give the reviewers early on about
the case and the documents (without overwhelm-
ing them), the better prepared they will be to
make judgment calls on coding specific docu-
ments during the review.
s Key Players – Include a detailed list of the key
players involved in the litigation. This generally
means including information about the litigants
themselves, other key parties, any employees or
document custodians whose names and e-mails the
reviewers will be seeing, and any attorneys or other
individuals who might be implicated in the privilege
review (e.g., doctors, accountants, etc.).
s Coding Instructions – Provide information re-
garding the actual coding procedures that the re-
viewers will use. The protocol should describe what
tagging fields to use for each document, as well as a
description or example of when each field or tag
should be used. In a typical review, reviewers usually
code for relevance, privilege, and confidentiality, at a
minimum. However, you should also consider coding
key documents, documents needing redactions, as
well as documents that fit under certain issues or cat-
egories.
ࡗ It is also helpful to clarify which coding
fields are mutually exclusive and which can co-
exist with other tags. For example, a document
can only be ‘‘Not Privileged’’ or ‘‘Privileged’’ – it
cannot be both. The same applies to confidential-
ity calls. Issue tags, on the other hand, will often
require the reviewers to select any and all of the
tags that apply.
s Responsive Criteria – Include guidance that will
allow the reviewers to determine the relevance of a
document. Giving the reviewers copies of each of the
opposing side’s document requests often proves un-
wieldy and impractical. It is best to summarize the
document requests or types of responsive documents
that the reviewers are looking for. (However, you
might consider including short excerpts of the lan-
guage from the document requests in the protocol to
make sure you do not inadvertently summarize the
requests more narrowly or more broadly than in-
tended.)
ࡗ If you choose to summarize the document
requests for the reviewers, it is wise to keep a
copy of the document requests on hand in the re-
view room for the supervising attorneys to con-
sult.
s Privilege Criteria – Provide guidelines for deter-
mining whether a document is privileged or confi-
dential. Relying on an attorney’s law school training
and understanding of privilege typically results in in-
accurate and inconsistent privilege calls.
ࡗ For the ‘‘Privilege’’ section, in addition to
providing guidance on the types of privilege calls
you expect to be made (attorney-client, work-
product, or others), you also need to provide guid-
ance on who the attorneys are, who the ‘‘client’’ is
(i.e., whether subsidiary or parent corporations
are included, how agents and representatives are
handled, etc.), and whether you are going to log
privileged documents that are created after the
litigation commenced.
s Confidentiality Criteria - For the ‘‘Confidential-
ity’’ section, clarify what types of documents should
be tagged ‘‘Not Confidential,’’ ‘‘Confidential,’’ and, if
applicable, ‘‘Attorneys’ Eyes Only’’ or the equivalent.
Be sure to consult the Protective Order entered into
in the case to provide guidance for these categories.
Again, if you can provide specific examples of the
types of documents you want coded for each cat-
egory, you will help ensure consistent coding over
the course of the review.
Finally, when putting together the review protocol,
spend some time thinking about how you want the re-
viewers to handle specific types of documents so they
are all handled consistently over the course of the re-
view. For example:
s You might specify that if the document con-
tains no data, image, or any type of content, or con-
tains only a logo, it should be tagged ‘‘NCB,’’ for
‘‘Non-Content Bearing.’’ Making this clear up front is
especially helpful for e-mail footers (e.g., the image
that says ‘‘Think before you print’’ or that contains
the client’s logo) and other recurring file types that
reviewers will encounter.1
s Clarify the standard for reviewing and coding
family members (‘‘family members’’ usually refers to
the scenario of a ‘‘parent’’ e-mail with its ‘‘children’’
attachments). Do you want the reviewers to code
each document on its face, or should the children
documents take the same coding as the parent? De-
ciding how you will treat family members that are
not responsive or privileged will need to be factored
into your decision.
Again, the reviewers will rely heavily on this review
protocol, so the more detailed and clear it is, the better
your work product will be.
Pre-review
Try to make time to conduct your own pre-review of
a small subset of the documents to get a feel for the
types of documents the reviewers will be facing, as well
as to ensure the coding fields make sense. This will give
you an idea of the reviewers’ work flow and help you
1
It’s important to have these coded consistently so that
when you are producing families, you know that all of those
e-mail logos either are or are not going to be produced with
their families.
2
7-7-15 COPYRIGHT 2015 BY THE BUREAU OF NATIONAL AFFAIRS, INC. LW ISSN 0148-8139
3. anticipate any issues that may arise in the first day or
two of the review.
s If there are large amounts of similar types of
documents (invoices, presentations, etc.), have ex-
amples to show reviewers during training and tell
them exactly how you want them coded.
Prepare in Advance With Vendor or Database
Manager
Regardless of whether your firm is using an outside
vendor or an in-house group to host the data and pro-
vide the review platform, you will have a database or
project manager (often referred to as a ‘‘DM’’ or ‘‘PM’’)
to work with who will set up the review platform. The
DM can create the issue tags and fields, create review
batches, help run searches, and assist with performing
quality control checks. It is wise to spend time with the
DM before the reviewers begin so that you can get ev-
erything configured properly. When working to set up
your review, consider the following:
s Ask to have a dedicated database manager for
the length of your review. In an ideal world, you
should be able to IM or e-mail the database manager
with quick questions, but at a minimum, you want a
direct line to get in touch with the DM at any time.
s Lock the reviewers’ platform views so that they
do not inadvertently turn off key user-interface fea-
tures of the platform (i.e., accidentally closing the
coding pane, mistakenly checking out multiple re-
view batches at once, etc.).
s Train all supervising attorneys on the use of the
tool and provide them with administrator creden-
tials. It is imperative that the supervising attorneys
stay involved in the review and guide the reviewers
throughout the process.
ࡗ As a practice tip, have the DM set up a ‘‘Sec-
ond Level Review Complete’’ issue tag in the re-
view pane for the supervising attorneys to use.
This way, every document that supervisors check
during the review will be marked for tracking pur-
poses. This will avoid doing duplicative work later
when conducting your second-level reviews be-
cause you can exclude those documents that the
supervisors have already reviewed.
s Train the review team on how and when to
choose between native, image, or text views in the
review platform. For instance, it is better to view
spreadsheets in native (so that all hidden rows and
worksheets are visible) whereas e-mails and word
documents are viewed better in text (where the for-
matting is clear and legible).
s Do not allow review batches to be marked com-
plete and checked back in unless all review criteria
are met.
s Make use of the highlighting feature that some
review platforms call ‘‘persistent highlighting.’’ The
highlighting tool allows you to define and use param-
eters to make certain defined words or terms always
appear highlighted during the document review,
such as attorney names or key terms. For example,
set all of your ‘‘potentially privileged’’ search terms
to be permanently highlighted. Seeing these terms
highlighted is an automatic cue to the review team to
be on alert that the document may be privileged.
s If the vendor or the review platform has the
ability to group similar document types, such as re-
curring monthly reports or accounts receivable
spreadsheets, consider batching those documents so
that the same reviewers are assigned batches con-
taining similar types of documents. This way, similar
documents are assigned to the same one or two re-
viewers, to ensure coding consistently.
ࡗ The same goes for e-mail threads—if the re-
view platform can group related e-mails, even if
not identical, you can ensure consistent coding by
having related e-mail threads all assigned to the
same review batch.
During Review
Assuming that your reviewers are all gathered at a
common location to conduct the review (whether at a
vendor or at your office), then you and other attorneys
at your firm should take turns supervising the docu-
ment review each day. It is important to have a case at-
torney supervisor on site to answer questions and pro-
vide guidance at all times.
Particularly when multiple supervising attorneys are
involved, it is important to establish a process to ensure
that the reviewers are being given consistent guidance
and answers to their questions each day. For instance,
a supervising attorney may see fit to announce to the re-
viewers that a certain type of invoice should always be
coded as ‘‘Relevant,’’ ‘‘Confidential,’’ and ‘‘Not Privi-
leged.’’ Each of the other supervising attorneys need to
be aware of that guidance to avoid giving conflicting
guidance later in the review. Below are a few tips to
help you ensure that everyone—reviewers and supervi-
sors alike—stays on the same page.
Daily Consistency
It is helpful to keep a running log of common ques-
tions and answers, major announcements, and guid-
ance on specific documents to pass along to supervising
attorneys. Whether it is a summary e-mail at the end of
the day or a shared Evernote page that all supervisors
can access, logging each of the days’ key announce-
ments and guidance will ensure consistency during the
course of the review.
In a similar vein, it is helpful to post key announce-
ments on a whiteboard in the review room or in a daily
handout to the reviewers. This will essentially serve as
a running update to the review protocol. Reviewers are
sure to have questions, and preserving the answers in
one place helps ensure consistency amongst the review-
ers’ coding (and will help cut down on the number of
repeat questions you have to answer).
Quality Control
As a supervisor, it is very helpful to spend time each
day in the review platform conducting a second-level
review/QC of documents that have been first-level re-
viewed, particularly early in the review. The earlier in
the process you can catch mistakes, the fewer issues
you will have at the end of the review. So, be sure to
keep these QC tips in mind.
s Take notes on what you find during your QC,
whether it is inconsistent coding amongst reviewers
on similar documents, specific documents you want
to highlight, incorrect usage of an issue tag, or the
like. Conducting a second-level review each day,
3
U.S. LAW WEEK ISSN 0148-8139 BNA 7-7-15
4. even if you can only look at 1 percent of the reviewed
documents, will help prevent surprises at the end of
the review. Each morning, the supervising attorney
should update the reviewers with clarifications, cor-
rections, or new guidance that stems from doing the
QC.
s Ask your DM to provide stats at the end of each
day to show individual reviewers’ progress. Review-
ers at either end of the spectrum—very fast or very
slow, in terms of documents reviewed per hour—
may warrant some additional scrutiny.
ࡗ For those reviewers needing additional scru-
tiny, consider doing a second-level review of a
small percentage of EACH of their documents.
This will let you determine whether the slowest
reviewers are having to slog through long, techni-
cal documents that slowed their pace, or whether
they are simply being slow and inefficient and
warrant a one-on-one conversation about their
pace.
s Also take note of any documents being tagged
with codes such as ‘‘Needs Further Review’’ or
‘‘Technical Issue.’’ You may be able to quickly clarify
early on how documents should be coded to avoid
having to do extra work at the end of the review.
Defensibility
As a final step and upon completion of the document
review, you should maintain records of the decisions
and processes used for executing the review. Keep a
copy of the review protocol and details concerning ad-
ditional guidance given to the reviewers, the quality
control performed, the collection criteria, the produc-
tion specifications, and any other pertinent material
throughout the pendency of the review. This record,
sometimes referred to as a ‘‘defensibility binder,’’ will
help you answer any questions about the review that
may later arise. It may also be useful in the event of a
discovery dispute to prove that the review and produc-
tion was completed with diligence and reasonable care.
Conclusion
Applying these techniques and suggestions will en-
sure that your next large-scale document review is run
efficiently, economically, and with minimal duplication
of efforts. This translates to success for you, your firm,
and your client.
4
7-7-15 COPYRIGHT 2015 BY THE BUREAU OF NATIONAL AFFAIRS, INC. LW ISSN 0148-8139