abercrombie
|
LegalBench |
Determine the Abercrombie classification for a mark/product pair. |
legal question |
100 |
19 |
canada_tax_court_outcomes
|
LegalBench |
Classify whether an excerpt from a Canada Tax Court decision includes the outcome of the appeal, and if so, specify whether the appeal was allowed or dismissed. |
judicial text |
250 |
7 |
citation_prediction_classification
|
LegalBench |
Determine if a case citation is supportive of a given legal statement. |
judicial text |
110 |
7 |
citation_prediction_open
|
LegalBench |
Given a legal statement, predict the name of the case which best supports the statement. |
judicial text |
55 |
7 |
consumer_contracts_qa
|
LegalBench |
Answer yes/no questions on the rights and obligations created by clauses in terms of services agreements. |
contract clause |
400 |
7 |
contract_nli_Notice on compelled disclosure
|
LegalBench |
Identify if the clause provides that the Receiving Party shall notify Disclosing Party in case Receiving Party is required by law, regulation or judicial process to disclose any Confidential Information. |
contract clause |
150 |
7 |
contract_nli_Permissible acquirement of similar information
|
LegalBench |
Identify if the clause provides that the Receiving Party may acquire information similar to Confidential Information from a third party. |
contract clause |
186 |
7 |
contract_nli_confidentiality_of_agreement
|
LegalBench |
Identify if the clause provides that the Receiving Party shall not disclose the fact that Agreement was agreed or negotiated. |
contract clause |
90 |
7 |
contract_nli_explicit_identification
|
LegalBench |
Determine whether a clause from an NDA specifies that all Confidential Information shall be expressly identified by the Disclosing Party. |
contract clause |
117 |
7 |
contract_nli_inclusion_of_verbally_conveyed_information
|
LegalBench |
Identify if the clause provides that Confidential Information may include verbally conveyed information. |
contract clause |
147 |
7 |
contract_nli_limited_use
|
LegalBench |
Determine whether a clause from a Non-Disclosure Agreement (NDA) restricts the Receiving Party's use of Confidential Information to the purposes stated in the Agreement. |
contract clause |
216 |
7 |
contract_nli_no_licensing
|
LegalBench |
Determine whether a clause from a non-disclosure agreement (NDA) grants the Receiving Party any rights to Confidential Information. |
contract clause |
170 |
7 |
contract_nli_permissible_copy
|
LegalBench |
Determine whether a clause from an NDA allows the Receiving Party to create a copy of Confidential Information under certain circumstances. |
contract clause |
95 |
7 |
contract_nli_permissible_development_of_similar_information
|
LegalBench |
Identify if the clause provides that the Receiving Party may independently develop information similar to Confidential Information. |
contract clause |
144 |
7 |
contract_nli_permissible_post-agreement_possession
|
LegalBench |
Determine if a clause from an NDA allows the Receiving Party to retain some Confidential Information after its return or destruction. |
contract clause |
119 |
7 |
contract_nli_return_of_confidential_information
|
LegalBench |
Identify if the clause provides that the Receiving Party shall destroy or return some Confidential Information upon the termination of Agreement. |
contract clause |
74 |
7 |
contract_nli_sharing_with_employees
|
LegalBench |
Determine whether a clause from an NDA allows the Receiving Party to share Confidential Information with its employees. |
contract clause |
178 |
7 |
contract_nli_sharing_with_third-parties
|
LegalBench |
Identify if the clause provides that the Receiving Party may share some Confidential Information with some third-parties (including consultants, agents and professional advisors). |
contract clause |
188 |
7 |
contract_nli_survival_of_obligations
|
LegalBench |
Identify if the clause provides that some obligations of Agreement may survive termination of Agreement. |
contract clause |
165 |
7 |
contract_qa
|
LegalBench |
The LLM must determine if language from a contract contains a particular type of content by answering yes/no questions. |
contract clause |
88 |
7 |
corporate_lobbying
|
LegalBench |
The Corporate Lobbying task requires an LLM to determine whether a proposed Congressional bill may be relevant to a company based on a company’s self-description in its SEC 10K filing. |
corporate disclosure |
500 |
7 |
cuad_affiliate_license-licensee
|
LegalBench |
Classify if a clause describes a license grant to a licensee (incl. sublicensor) and the affiliates of such licensee/sublicensor. |
contract clause |
204 |
7 |
cuad_affiliate_license-licensor
|
LegalBench |
Classify if the clause describes a license grant by affiliates of the licensor or that includes intellectual property of affiliates of the licensor. |
contract clause |
94 |
7 |
cuad_anti-assignment
|
LegalBench |
Classify if the clause requires consent or notice of a party if the contract is assigned to a third party. |
contract clause |
1178 |
7 |
cuad_audit_rights
|
LegalBench |
Classify if the clause gives a party the right to audit the books, records, or physical locations of the counterparty to ensure compliance with the contract. |
contract clause |
1222 |
7 |
cuad_cap_on_liability
|
LegalBench |
Classify if the clause specifies a cap on liability upon the breach of a party’s obligation. |
contract clause |
1252 |
7 |
cuad_change_of_control
|
LegalBench |
Classify if the clause gives one party the right to terminate or if consent or notice is required of the counterparty in the event of a change of control. |
contract clause |
422 |
7 |
cuad_competitive_restriction_exception
|
LegalBench |
Classify if the clause mentions exceptions or carveouts to Non-Compete, Exclusivity and No-Solicit of Customers. |
contract clause |
226 |
7 |
cuad_covenant_not_to_sue
|
LegalBench |
Classify if the clause specifies that a party is restricted from contesting the validity of the counterparty’s ownership of intellectual property or otherwise bringing a claim against the counterparty for matters unrelated to the contract. |
contract clause |
314 |
7 |
cuad_effective_date
|
LegalBench |
Classify if the clause specifies the date upon which the agreement becomes effective. |
contract clause |
242 |
7 |
cuad_exclusivity
|
LegalBench |
Classify if the clause specifies exclusive dealing commitment with the counterparty. |
contract clause |
768 |
7 |
cuad_expiration_date
|
LegalBench |
Classify if the clause specifies the date upon which the initial term expires. |
contract clause |
882 |
7 |
cuad_governing_law
|
LegalBench |
Classify if the clause specifies which state/country's law governs the contract. |
contract clause |
882 |
7 |
cuad_insurance
|
LegalBench |
Classify if a clause creates a requirement for insurance that must be maintained by one party for the benefit of the counterparty. |
contract clause |
1036 |
7 |
cuad_ip_ownership_assignment
|
LegalBench |
The LLM must classify whether a contractual clause specifies that intellectual property created by one party becomes the property of the counterparty. |
contract clause |
582 |
7 |
cuad_irrevocable_or_perpetual_license
|
LegalBench |
Classify if the clause specifies a license grant that is irrevocable or perpetual. |
contract clause |
286 |
7 |
cuad_joint_ip_ownership
|
LegalBench |
Classify if the clause provides for joint or shared ownership of intellectual property between the parties to the contract. |
contract clause |
198 |
7 |
cuad_license_grant
|
LegalBench |
Classify if the clause contains a license granted by one party to its counterparty. |
contract clause |
1402 |
7 |
cuad_liquidated_damages
|
LegalBench |
Classify if the clause awards either party liquidated damages for breach or a fee upon the termination of a contract (termination fee). |
contract clause |
226 |
7 |
cuad_minimum_commitment
|
LegalBench |
Classify if the clause specifies a minimum order size or minimum amount or units per time period that one party must buy from the counterparty. |
contract clause |
778 |
7 |
cuad_most_favored_nation
|
LegalBench |
The model must determine if a contractual clause qualifies as a 'Most Favored Nation' clause based on specified criteria. |
contract clause |
70 |
7 |
cuad_no-solicit_of_customers
|
LegalBench |
Classify if the clause restricts a party from contracting or soliciting customers or partners of the counterparty, whether during the contract or after the contract ends (or both). |
contract clause |
90 |
7 |
cuad_no-solicit_of_employees
|
LegalBench |
Classify if the clause restricts a party’s soliciting or hiring employees and/or contractors from the counterparty, whether during the contract or after the contract ends (or both). |
contract clause |
148 |
7 |
cuad_non-compete
|
LegalBench |
Classify if the clause restricts the ability of a party to compete with the counterparty or operate in a certain geography or business or technology sector. |
contract clause |
448 |
7 |
cuad_non-disparagement
|
LegalBench |
Classify if the clause requires a party not to disparage the counterparty. |
contract clause |
106 |
7 |
cuad_non-transferable_license
|
LegalBench |
Classify if the clause limits the ability of a party to transfer the license being granted to a third party. |
contract clause |
548 |
7 |
cuad_notice_period_to_terminate_renewal
|
LegalBench |
Classify if the clause specifies a notice period required to terminate renewal. |
contract clause |
228 |
7 |
cuad_post-termination_services
|
LegalBench |
Classify if the clause subjects a party to obligations after the termination or expiration of a contract, including any post-termination transition, payment, transfer of IP, wind-down, last-buy, or similar commitments. |
contract clause |
814 |
7 |
cuad_price_restrictions
|
LegalBench |
Classify if the clause places a restriction on the ability of a party to raise or reduce prices of technology, goods, or services provided. |
contract clause |
52 |
7 |
cuad_renewal_term
|
LegalBench |
The model must determine if a contractual clause specifies a renewal term. |
contract clause |
392 |
7 |
cuad_revenue-profit_sharing
|
LegalBench |
Classify if the clause requires a party to share revenue or profit with the counterparty for any technology, goods, or services. |
contract clause |
780 |
7 |
cuad_rofr-rofo-rofn
|
LegalBench |
Classify if the clause grants one party a right of first refusal, right of first offer, or right of first negotiation to purchase, license, market, or distribute equity interest, technology, assets, products, or services. |
contract clause |
696 |
7 |
cuad_source_code_escrow
|
LegalBench |
Classify if the clause requires one party to deposit its source code into escrow with a third party, which can be released to the counterparty upon the occurrence of certain events. |
contract clause |
124 |
7 |
cuad_termination_for_convenience
|
LegalBench |
Classify if the clause specifies that one party can terminate this contract without cause (solely by giving a notice and allowing a waiting period to expire). |
contract clause |
436 |
7 |
cuad_third_party_beneficiary
|
LegalBench |
Classify if the clause specifies that there is a non-contracting party who is a beneficiary to some or all of the clauses in the contract and therefore can enforce its rights against a contracting party. |
contract clause |
74 |
7 |
cuad_uncapped_liability
|
LegalBench |
Classify if the clause specifies that a party’s liability is uncapped upon the breach of its obligation in the contract. |
contract clause |
300 |
7 |
cuad_unlimited-all-you-can-eat-license
|
LegalBench |
Classify if the clause grants one party an 'enterprise,' 'all you can eat' or unlimited usage license. |
contract clause |
54 |
7 |
cuad_volume_restriction
|
LegalBench |
Classify if the clause specifies a fee increase or consent requirement, etc. if one party’s use of the product/services exceeds certain threshold. |
contract clause |
328 |
7 |
cuad_warranty_duration
|
LegalBench |
Classify if the clause specifies a duration of any warranty against defects or errors in technology, products, or services provided under the contract. |
contract clause |
326 |
7 |
definition_classification
|
LegalBench |
Given a sentence from a Supreme Court opinion, classify whether or not that sentence offers a definition of a term. |
judicial text |
1345 |
7 |
definition_extraction
|
LegalBench |
Extract the term being defined in sentences from Supreme Court opinions. |
judicial text |
695 |
7 |
diversity_1
|
LegalBench |
Determine if the criteria for diversity jurisdiction have been met based on the citizenships of plaintiffs and defendants and the amounts associated with claims. |
fact pattern |
306 |
19 |
diversity_2
|
LegalBench |
Determine if the criteria for diversity jurisdiction have been met based on the citizenships of plaintiffs and defendants and the amounts associated with claims. |
fact pattern |
306 |
19 |
diversity_3
|
LegalBench |
Determine if the criteria for diversity jurisdiction have been met based on the citizenships of plaintiffs and defendants and the amounts associated with claims. |
fact pattern |
306 |
19 |
diversity_4
|
LegalBench |
Determine if the criteria for diversity jurisdiction have been met based on the citizenships of plaintiffs and defendants and the amounts associated with claims. |
fact pattern |
306 |
19 |
diversity_5
|
LegalBench |
Determine if the criteria for diversity jurisdiction have been met based on the citizenships of plaintiffs and defendants and the amounts associated with claims. |
fact pattern |
306 |
19 |
diversity_6
|
LegalBench |
Determine if the criteria for diversity jurisdiction have been met based on the citizenships of plaintiffs and defendants and the amounts associated with claims. |
fact pattern |
306 |
19 |
function_of_decision_section
|
LegalBench |
Classify the function of different sections of legal written opinions. |
judicial text |
374 |
7 |
hearsay
|
LegalBench |
Classify if a particular piece of evidence qualifies as hearsay. |
fact pattern |
99 |
19 |
housing_qa_knowledge_only
|
HousingQA |
Answer questions about eviction law according to state law in 2021, using only knowledge encoded in model weights. |
legal question |
6853 |
4 |
housing_qa_statute_comprehension
|
HousingQA |
Answer questions about eviction law according to state law in 2021, given the relevant statute text. |
legal question |
6853 |
9 |
insurance_policy_interpretation
|
LegalBench |
Given an insurance claim and policy, determine whether the claim is covered by the policy. |
legal text |
138 |
7 |
international_citizenship_questions
|
LegalBench |
Answer questions about citizenship law from across the world. |
legal question |
9310 |
7 |
jcrew_blocker
|
LegalBench |
Classify if a clause in a loan agreement is a J.Crew blocker provision. |
legal text |
60 |
7 |
learned_hands_benefits
|
LegalBench |
Classify if a user post implicates legal issues related to benefits. |
legal question |
72 |
7 |
learned_hands_business
|
LegalBench |
Classify if a user post implicates legal issues related to business. |
legal question |
180 |
7 |
learned_hands_consumer
|
LegalBench |
Classify if a user post implicates legal issues related to consumer. |
legal question |
620 |
7 |
learned_hands_courts
|
LegalBench |
Classify if a user post implicates legal issues related to courts. |
legal question |
198 |
7 |
learned_hands_crime
|
LegalBench |
Classify if a user post implicates legal issues related to crime. |
legal question |
694 |
7 |
learned_hands_divorce
|
LegalBench |
Classify if a user post implicates legal issues related to divorce. |
legal question |
156 |
7 |
learned_hands_domestic_violence
|
LegalBench |
Classify if a user post implicates legal issues related to domestic violence. |
legal question |
180 |
7 |
learned_hands_education
|
LegalBench |
Classify if a user post implicates legal issues related to education. |
legal question |
62 |
7 |
learned_hands_employment
|
LegalBench |
Classify if a user post implicates legal issues related to employment. |
legal question |
716 |
7 |
learned_hands_estates
|
LegalBench |
Classify if a user post implicates legal issues related to estates. |
legal question |
184 |
7 |
learned_hands_family
|
LegalBench |
Classify if a user post implicates legal issues related to family. |
legal question |
2271 |
7 |
learned_hands_health
|
LegalBench |
Classify if a user post implicates legal issues related to health. |
legal question |
232 |
7 |
learned_hands_housing
|
LegalBench |
Classify if a user post implicates legal issues related to housing. |
legal question |
4500 |
7 |
learned_hands_immigration
|
LegalBench |
Classify if a user post implicates legal issues related to immigration. |
legal question |
140 |
7 |
learned_hands_torts
|
LegalBench |
Classify if a user post implicates legal issues related to torts. |
legal question |
438 |
7 |
learned_hands_traffic
|
LegalBench |
Classify if a user post implicates legal issues related to traffic. |
legal question |
562 |
7 |
legal_reasoning_causality
|
LegalBench |
Classify whether a district court opinion excerpt relies on statistical evidence in its reasoning for finding causality. |
judicial text |
59 |
7 |
maud_ability_to_consummate_concept_is_subject_to_mae_carveouts
|
LegalBench |
Determine whether the 'ability to consummate' concept in a merger agreement is subject to Material Adverse Effect (MAE) carveouts. |
merger agreement |
70 |
7 |
maud_accuracy_of_fundamental_target_rws_bringdown_standard
|
LegalBench |
This is a multiple-choice task in which the model must select the answer that best characterizes the accuracy required for fundamental representations and warranties in a merger agreement according to the bring down provision. |
merger agreement |
176 |
7 |
maud_accuracy_of_target_"general"_r&w:_bringdown_timing_answer
|
LegalBench |
The LLM must read an excerpt from a merger agreement and select the correct timing for when representations and warranties are required according to the bring down provision. |
merger agreement |
182 |
7 |
maud_accuracy_of_target_capitalization_rw_(outstanding_shares)_bringdown_standard_answer
|
LegalBench |
This is a multiple-choice task in which the model must select the answer that best characterizes the accuracy required for capitalization representations and warranties in a merger agreement according to the bring down provision. |
merger agreement |
182 |
7 |
maud_additional_matching_rights_period_for_modifications_(cor)
|
LegalBench |
This is a multiple-choice task in which the model must select the answer that best characterizes the merger agreement regarding the duration of the additional matching rights period for modifications if the board changes its recommendation. |
merger agreement |
159 |
7 |
maud_application_of_buyer_consent_requirement_(negative_interim_covenant)
|
LegalBench |
The model must select the answer that best characterizes the negative covenants to which the requirement of Buyer consent applies in a merger agreement. |
merger agreement |
181 |
7 |
maud_buyer_consent_requirement_(ordinary_course)
|
LegalBench |
The model must determine if there are any limitations on the Buyer’s right to condition, withhold, or delay their consent regarding the acquired company’s ordinary business operations based on an excerpt from a merger agreement. |
merger agreement |
182 |
7 |
maud_change_in_law__subject_to_disproportionate_impact_modifier
|
LegalBench |
The model must determine whether changes in law that have a disproportionate impact qualify for Material Adverse Effect (MAE) based on an excerpt from a merger agreement. |
merger agreement |
100 |
7 |
maud_changes_in_gaap_or_other_accounting_principles__subject_to_disproportionate_impact_modifier
|
LegalBench |
The model must determine whether changes in GAAP or other accounting principles that have a disproportionate impact qualify for Material Adverse Effect (MAE) based on an excerpt from a merger agreement. |
merger agreement |
99 |
7 |
maud_cor_permitted_in_response_to_intervening_event
|
LegalBench |
The model must determine whether a Change of Recommendation is permitted in response to an intervening event based on an excerpt from a merger agreement. |
merger agreement |
101 |
7 |
maud_cor_permitted_with_board_fiduciary_determination_only
|
LegalBench |
The model must determine whether a Change of Recommendation is permitted in a merger agreement if the board concludes that such a change is necessary to meet its fiduciary duties. |
merger agreement |
101 |
7 |
maud_cor_standard_(intervening_event)
|
LegalBench |
The model must select the answer that best characterizes the standard the board should follow when determining whether to change its recommendation in response to an intervening event in a merger agreement. |
merger agreement |
85 |
7 |
maud_cor_standard_(superior_offer)
|
LegalBench |
This is a multiple-choice task in which the model must select the answer that best characterizes the merger agreement regarding the standard the board should follow when determining whether to change its recommendation in connection with a superior offer. |
merger agreement |
101 |
7 |
maud_definition_contains_knowledge_requirement_-_answer
|
LegalBench |
The model must select the answer that best characterizes the knowledge requirement in the definition of 'Intervening Event' from a segment of a merger agreement. |
merger agreement |
148 |
7 |
maud_definition_includes_asset_deals
|
LegalBench |
The model must select the answer that best characterizes what qualifies as a superior offer in terms of asset deals from a merger agreement excerpt. |
merger agreement |
147 |
7 |
maud_definition_includes_stock_deals
|
LegalBench |
The model must select the answer that best characterizes what qualifies as a superior offer in terms of stock deals within a merger agreement. |
merger agreement |
149 |
7 |
maud_fiduciary_exception:_board_determination_trigger_(no_shop)
|
LegalBench |
This is a multiple-choice task in which the model must select the answer that best characterizes the merger agreement regarding the type of offer the Board could act on despite the no-shop provision. |
merger agreement |
180 |
7 |
maud_fiduciary_exception__board_determination_standard
|
LegalBench |
The model must select the answer that best characterizes the circumstances under which the Board could take actions on a different acquisition proposal notwithstanding the no-shop provision in a merger agreement. |
merger agreement |
180 |
7 |
maud_financial_point_of_view_is_the_sole_consideration
|
LegalBench |
The model must determine if 'financial point of view' is the sole consideration in assessing the superiority of an offer in a merger agreement. |
merger agreement |
113 |
7 |
maud_fls_(mae)_standard
|
LegalBench |
The model must select the answer that best characterizes the Forward Looking Standard (FLS) with respect to Material Adverse Effect (MAE) from an excerpt of a merger agreement. |
merger agreement |
78 |
7 |
maud_general_economic_and_financial_conditions_subject_to_disproportionate_impact_modifier
|
LegalBench |
The model must determine whether changes caused by general economic and financial conditions that have a disproportionate impact qualify for Material Adverse Effect (MAE) based on an excerpt from a merger agreement. |
merger agreement |
99 |
7 |
maud_includes_consistent_with_past_practice
|
LegalBench |
The model must determine if the Efforts Covenant clause in a merger agreement includes the phrase 'consistent with past practice'. |
merger agreement |
182 |
7 |
maud_initial_matching_rights_period_(cor)
|
LegalBench |
This is a multiple-choice task in which the model must select the answer that best characterizes the merger agreement regarding the duration of the initial matching rights period if the board changes its recommendation. |
merger agreement |
159 |
7 |
maud_initial_matching_rights_period_(ftr)
|
LegalBench |
The model must select the answer that best characterizes the duration of the initial matching rights period in connection with the Fiduciary Termination Right (FTR) from a merger agreement excerpt. |
merger agreement |
133 |
7 |
maud_intervening_event_-_required_to_occur_after_signing_-_answer
|
LegalBench |
This task requires the model to determine whether an 'Intervening Event' is mandated to occur after the signing of a merger agreement. |
merger agreement |
148 |
7 |
maud_knowledge_definition
|
LegalBench |
The model must select the answer that best characterizes the concept of Knowledge in a merger agreement. |
merger agreement |
168 |
7 |
maud_liability_standard_for_no-shop_breach_by_target_non-d&o_representatives
|
LegalBench |
The model must select the answer that best characterizes the liability standard for no-shop breach by Target Non-D&O Representatives in a merger agreement. |
merger agreement |
157 |
7 |
maud_ordinary_course_efforts_standard
|
LegalBench |
The model must select the answer that best characterizes the efforts standard in a merger agreement excerpt. |
merger agreement |
182 |
7 |
maud_pandemic_or_other_public_health_event__subject_to_"disproportionate_impact"_modifier
|
LegalBench |
The model must determine whether pandemics or other public health events need to have a disproportionate impact to qualify for Material Adverse Effect (MAE) based on an excerpt from a merger agreement. |
merger agreement |
99 |
7 |
maud_pandemic_or_other_public_health_event_specific_reference_to_pandemic-related_governmental_responses_or_measures
|
LegalBench |
The model must determine if there is a specific reference to pandemic-related governmental responses or measures in a merger agreement clause that qualifies pandemics or other public health events for Material Adverse Effect (MAE). |
merger agreement |
99 |
7 |
maud_relational_language_(mae)_applies_to
|
LegalBench |
The model must select the answer that best characterizes the carveouts pertaining to Material Adverse Effect (MAE) in a merger agreement excerpt. |
merger agreement |
91 |
7 |
maud_specific_performance
|
LegalBench |
This task requires the model to read an excerpt from a merger agreement and select the correct wording of the Specific Performance clause regarding the parties’ entitlement in the event of a contractual breach. |
merger agreement |
179 |
7 |
maud_tail_period_length
|
LegalBench |
The model must read an excerpt from a merger agreement and determine the duration of the Tail Period by selecting the best answer from multiple-choice options. |
merger agreement |
180 |
7 |
maud_type_of_consideration
|
LegalBench |
The model must select the answer that best characterizes the type of consideration specified in a merger agreement. |
merger agreement |
173 |
7 |
nys_judicial_ethics
|
LegalBench |
Answer questions on judicial ethics from the New York State Unified Court System Advisory Committee. |
legal question |
300 |
7 |
opp115_data_retention
|
LegalBench |
Classify whether a clause from a privacy policy describes how long user information is stored. |
privacy policy |
96 |
7 |
opp115_data_security
|
LegalBench |
Classify whether a clause from a privacy policy describes how user information is protected. |
privacy policy |
1342 |
7 |
opp115_do_not_track
|
LegalBench |
Classify if a clause from a privacy policy describes if and how Do Not Track signals for online tracking and advertising are honored. |
privacy policy |
118 |
7 |
opp115_first_party_collection_use
|
LegalBench |
Classify whether a clause from a privacy policy describes how and why a service provider collects user information. |
privacy policy |
2094 |
7 |
opp115_international_and_specific_audiences
|
LegalBench |
Classify whether a clause from a privacy policy describes practices that pertain only to a specific group of users. |
privacy policy |
988 |
7 |
opp115_policy_change
|
LegalBench |
Classify if a clause from a privacy policy describes if and how users will be informed about changes to the privacy policy. |
privacy policy |
439 |
7 |
opp115_third_party_sharing_collection
|
LegalBench |
Classify whether a clause from a privacy policy describes how user information may be shared with or collected by third parties. |
privacy policy |
1598 |
7 |
opp115_user_access,_edit_and_deletion
|
LegalBench |
Classify if a clause from a privacy policy describes if and how users may access, edit, or delete their information. |
privacy policy |
470 |
6 |
opp115_user_choice_control
|
LegalBench |
Classify if a clause from a privacy policy describes the choices and control options available to users. |
privacy policy |
1554 |
7 |
oral_argument_question_purpose
|
LegalBench |
Given a question asked during oral argument, classify the purpose of the question. |
oral argument |
319 |
7 |
overruling
|
LegalBench |
Classify whether a sentence from a judicial opinion overrules a previous case. |
judicial text |
2400 |
7 |
personal_jurisdiction
|
LegalBench |
Determine if a court in a given forum can exercise personal jurisdiction over a defendant based on their contacts with that forum. |
fact pattern |
54 |
19 |
privacy_policy_entailment
|
LegalBench |
Determine if the description of a privacy policy clause is correct. |
privacy policy |
4343 |
7 |
privacy_policy_qa
|
LegalBench |
Determine if a clause from a privacy policy contains enough information to answer a given question. |
privacy policy |
10931 |
7 |
proa
|
LegalBench |
Given a statute, determine if the text contains an explicit private right of action. |
statute |
100 |
7 |
sara_entailment
|
LegalBench |
Given a statute, a fact pattern, and an assertion, determine if the assertion is 'entailed' by the fact pattern and statute. |
fact pattern |
276 |
7 |
scalr
|
LegalBench |
Given a legal question, identify the holding statement (amongst a set of candidates) that best answers a particular legal question. |
legal question |
571 |
7 |
ssla_company_defendants
|
LegalBench |
This task requires the LLM to extract the identities of company defendants from excerpts of securities class action complaints. |
complaint |
1231 |
7 |
ssla_individual_defendants
|
LegalBench |
This task requires the LLM to extract the identities of individual defendants from excerpts of securities class action complaints. |
complaint |
1015 |
7 |
ssla_plaintiff
|
LegalBench |
Extract the identities of the plaintiffs from excerpts of securities class action complaints. |
complaint |
1036 |
7 |
statutory_reasoning_assessment
|
LegalBench |
Given a statute and a set of facts, determine how much tax an individual owes. |
statute |
100 |
7 |
successor_liability
|
LegalBench |
Given a fact pattern, identify the type of successor liability present. |
fact pattern |
50 |
19 |
supply_chain_disclosure_best_practice_accountability
|
LegalBench |
Determine if a supply chain disclosure indicates whether the retail seller or manufacturer maintains internal compliance procedures regarding human trafficking and slavery. |
corporate disclosure |
387 |
7 |
supply_chain_disclosure_best_practice_audits
|
LegalBench |
Given a supply chain disclosure, determine if the statement discloses whether the retail seller or manufacturer performs any type of audit, or reserves the right to audit. |
corporate disclosure |
387 |
7 |
supply_chain_disclosure_best_practice_certification
|
LegalBench |
Determine if a supply chain disclosure indicates whether the retail seller or manufacturer requires direct suppliers to certify compliance with labor and anti-trafficking laws. |
corporate disclosure |
386 |
7 |
supply_chain_disclosure_best_practice_training
|
LegalBench |
Determine if a supply chain disclosure indicates whether the retail seller or manufacturer provides training to employees on human trafficking and slavery. |
corporate disclosure |
387 |
7 |
supply_chain_disclosure_best_practice_verification
|
LegalBench |
Determine if a supply chain disclosure indicates engagement in verification and auditing practices or assessment of supplier risks. |
corporate disclosure |
387 |
7 |
supply_chain_disclosure_disclosed_accountability
|
LegalBench |
Determine whether a supply chain disclosure reveals the extent of internal accountability standards and procedures related to slavery and trafficking for employees or contractors. |
corporate disclosure |
386 |
7 |
supply_chain_disclosure_disclosed_audits
|
LegalBench |
Given a disclosure, determine whether the statement discloses to what extent, if any, that the retail seller or manufacturer conducts audits of suppliers to evaluate supplier compliance with company standards for trafficking and slavery in supply chains. |
corporate disclosure |
387 |
7 |
supply_chain_disclosure_disclosed_certification
|
LegalBench |
Determine if a supply chain disclosure indicates the extent to which a retail seller or manufacturer requires direct suppliers to certify compliance with laws regarding slavery and human trafficking. |
corporate disclosure |
386 |
7 |
supply_chain_disclosure_disclosed_training
|
LegalBench |
Determine if a supply chain disclosure indicates whether training on human trafficking and slavery is provided to employees and management responsible for supply chain management. |
corporate disclosure |
387 |
7 |
supply_chain_disclosure_disclosed_verification
|
LegalBench |
Determine if a supply chain disclosure indicates whether the retail seller or manufacturer verifies product supply chains to address risks of human trafficking and slavery. |
corporate disclosure |
387 |
7 |
telemarketing_sales_rule
|
LegalBench |
Determine how 16 C.F.R. § 310.3(a)(1) and 16 C.F.R. § 310.3(a)(2) apply to different fact patterns. |
fact pattern |
51 |
7 |
textualism_tool_dictionaries
|
LegalBench |
Determine if a paragraph from a judicial opinion is applying a form of textualism that relies on the dictionary meaning of terms. |
judicial text |
111 |
7 |
textualism_tool_plain
|
LegalBench |
Determine if a paragraph from a judicial opinion is applying a form of textualism that relies on the ordinary ('plain') meaning of terms. |
judicial text |
169 |
7 |
ucc_v_common_law
|
LegalBench |
Determine whether a contract is governed by the Uniform Commercial Code (UCC) or the common law of contracts. |
fact pattern |
100 |
19 |
unfair_tos
|
LegalBench |
Given a clause from a terms-of-service contract, determine the category the clause belongs to. |
contract clause |
3822 |
7 |