Exploration and Production

The Upstream Sector

Exploration and production (E&P), also known as the upstream sector, is the highest-risk and most lucrative part of the oil industry. The costs involved in the earliest stage are called finding and development (F&D) costs. Everything begins with securing the legal right to explore.

Obtaining Rights to Explore and Drill

Before an oil company can begin to explore, it must obtain permission from two owners: the surface property owner, and the owner of the mineral rights to the petroleum beneath the surface. In most countries, any valuable minerals below the surface are owned by the government, even if the land above is privately held. The US and Canada are rare exceptions where private individuals can own mineral rights on private land.

In the US, a person called a landman negotiates the purchase of exploration and production rights. Investing to find oil is called an oil play and a geological feature of interest is known as a lead. Once surface and mineral rights are legally secured, the oil play and lead become a prospect.

Oil beneath the surface is governed by the rule of capture, a legal principle based on English common law. If you extract oil from land you own, it is yours, even if the oil originally migrated from beneath a neighbor's land. However, you cannot use slant drilling to physically put a wellbore under a neighbor's property (subsurface trespass). Iraq cited alleged slant drilling by Kuwait as one pretext for its 1990 invasion.

Types of E&P Agreements

There are five main types of agreement between an exploring company and the mineral rights owner:

How Oil Forms: Source Rock, Reservoir Rock, and Cap Rock

Geologists searching for oil look for three essential features: a source rock containing kerogen (the organic precursor to oil), a porous reservoir rock that can hold oil and allow it to flow, and an impermeable cap rock (or trap) that prevents oil from migrating to the surface.

Kerogen is a solid, dark, waxy material formed from dead marine organisms (plankton, algae) deposited in oxygen-poor environments on ancient ocean floors. When buried to sufficient depth, heat and pressure crack kerogen's heavy molecules into lighter hydrocarbons. The oil window is the range of depths (roughly 7,500-15,000 feet, or 2.3-4.6 km) where temperatures are right to form liquid oil. Below this, in the gas window, everything is cracked into methane.

Reservoir Mechanics: Pressure Is Everything

Oil does not sit in underground lakes. It is trapped in tiny pores within rock, like water in a rigid sponge. Oil moves to the bottom of a well because reservoir pressure exceeds the low pressure at the wellbore. Every barrel extracted reduces reservoir pressure. There is anoptimal rate of production that maximizes total recovery: producing too fast depletes pressure prematurely, permanently stranding oil in the ground.

The recovery factor (percentage of original oil in place that can be extracted) averages only about 30% worldwide. It is exceptional to achieve above 60%. Natural drive mechanisms include:

Each mechanism is "rate sensitive": producing too aggressively can permanently reduce total recoverable oil. The rule of capture historically caused producers to race to extract as fast as possible from shared reservoirs, destroying value. In the early days at Spindletop, oil fields were covered in thousands of wells every few feet. Today, standard well spacing is typically 40 acres per well, with infill drilling permitted as economics warrant.

Exploration: Seismic Surveys

Modern exploration relies on seismic surveys: sending sound waves into the earth and analyzing their reflections to map underground rock formations. A seismic source (vibrator trucks onshore, air guns offshore) generates waves that travel through rock layers. When waves hit a boundary between different rock types, some energy reflects back to the surface where it is recorded by receivers called geophones (onshore) or hydrophones (offshore).

2D seismic produces cross-section images along a single line. 3D seismic uses a grid of source and receiver lines to create a three-dimensional picture of the subsurface. 4D seismic (time-lapse) repeats 3D surveys over time to track how fluids move through a producing reservoir. Despite these advances, the success rate for wildcat wells (drilled in unexplored areas) remains only 10-20%.

Drilling

Once a prospect is identified, a rotary drilling rig bores into the earth. The drill string consists of a rotating drill bit at the bottom, connected to the surface by drill pipe. Drilling mud (a carefully engineered fluid) is pumped down the drill pipe and returns up the annulus (the space between the pipe and the borehole wall), carrying rock cuttings to the surface and maintaining pressure to prevent blowouts.

Wells are lined with steel casing (cemented in place) to prevent collapse and isolate different pressure zones. The bottom of the well is completed by perforating the casing to allow oil to flow in. A Christmas tree (a set of valves and fittings) sits on top of the wellhead to control flow.

Drilling Mud Chemistry

Drilling mud is the unsung hero of every well. It serves five simultaneous jobs: lifting rock cuttings from the bit face to the surface; maintaining hydrostatic pressure in the wellbore to counterbalance formation pressure and prevent kicks; cooling and lubricating the drill bit; forming a thin impermeable filter cake on the borehole wall to stabilize soft formations; and suspending cuttings in place when circulation stops, so the hole does not pack off. There are three main mud families. Water-based muds (WBM) are the cheapest and most common, built on fresh or salt water with bentonite clay and barite weighting material. Oil-based muds (OBM) use diesel or mineral oil as the continuous phase and are preferred in shales that react with water, in high-temperature wells, and in highly deviated holes. Synthetic-based muds (SBM) substitute engineered esters or olefins for diesel to meet offshore environmental rules. Mud weight is quoted in pounds per gallon, with 9 ppg roughly neutral and 14 to 18 ppg typical for high-pressure deepwater sections.

Well Logging

A well is only as useful as the data it produces. Three logging techniques compete for each foot of new hole. The cheapest is the mud log: a geologist watches cuttings return to the shale shaker and records lithology, gas shows, and drilling rate depth by depth. Wireline logs are run after drilling stops. A logging tool is lowered on an electrical cable and measures gamma ray (shale content), resistivity (hydrocarbon vs water), density and neutron porosity (pore volume), and sonic velocity (rock mechanics). These measurements are cross-plotted to identify pay zones and estimate hydrocarbon saturation. Logging while drilling (LWD) embeds the same sensors into the drill collar just above the bit, so the geosteering team sees formation properties in near real time and can adjust the wellbore to stay inside a thin pay zone. LWD is the dominant logging method for horizontal shale wells, where pulling a wireline tool around the curve is impractical.

Drill Bits and Directional Tools

Two drill-bit families dominate the field. Roller cone bits use three rotating cones with hardened teeth (milled tooth for soft formations or tungsten carbide inserts for hard rock) and cut rock by crushing and scraping. Polycrystalline diamond compact (PDC) bits have no moving parts: they shear rock with fixed synthetic diamond cutters. PDC bits last longer and drill faster in most shales and carbonates, and they now account for the majority of footage in US land drilling. Directional control comes from a mud motor (a positive-displacement motor powered by the mud stream, with a bent housing that deflects the bit) or a rotary steerable system (RSS) that steers while the full drill string rotates, giving a smoother hole and faster build rates. Survey tools in the bottom-hole assembly measure inclination and azimuth, so the driller always knows where the bit is pointing to within a degree or two.

Blowout Preventers and Well Control

If formation pressure suddenly exceeds mud-column pressure, hydrocarbons rush into the wellbore (a kick) and can reach the surface uncontrolled (a blowout). The last line of defense is the blowout preventer stack. A BOP stack combines two families of valves. Annular preventers squeeze a donut-shaped rubber element around whatever is in the wellbore, sealing around drill pipe, casing, or an open hole. Ram preventers drive two opposing steel blocks together: pipe rams seal around a specific pipe diameter, blind rams close on an open hole, and shear rams are built to physically cut the drill pipe and seal the well in a worst-case emergency. On a subsea well, the BOP stack sits on the seafloor and is connected to the rig through a marine riser and a lower marine riser package. The 2010 Macondo blowout at the Deepwater Horizon rig became the reference case for BOP failure: the shear rams did not fully cut the drill pipe, the wellhead blew, the rig burned and sank, and 4.9 million barrels of crude were released into the Gulf of Mexico over 87 days. Chapter 15 (Environmental) covers the response.

Drilling can be vertical, directional (angled), or horizontal (turning 90 degrees to run laterally through a formation). Horizontal drilling, combined with hydraulic fracturing, was the breakthrough that unlocked the shale revolution. A modern Permian well typically drills 10,000 feet of vertical hole, builds curvature over a few hundred feet, and then runs 2 to 3 miles horizontally through the pay zone, all in under 10 days.

Production Phases

Primary recovery is the first phase of production. Most new wells initially flow under natural reservoir pressure, requiring no pump at all. As pressure declines over months or years, artificial lift becomes necessary. The most common method is the sucker-rod pump, the iconic "nodding donkey" pumpjack visible across the US oil patch. Sucker-rod pumps are used on the majority of US onshore producing wells, especially older stripper wells producing under 15 barrels per day. Other artificial lift methods include electric submersible pumps (ESPs, favored in high-rate offshore and shale wells), gas lift (injecting gas to lighten the fluid column), progressive cavity pumps, and jet pumps. By well count, over 90 percent of the roughly 500,000 producing wells in the US use some form of artificial lift because most are mature, low-rate stripper wells. By production volume, the picture is different: newer high-rate wells, particularly in the Permian and offshore Gulf of Mexico, often flow under natural reservoir pressure for their first several years. Globally, the majority of Middle Eastern production flows naturally without any pump. The distinction matters: most wells use pumps (because most wells are old and low-rate), but a large share of barrels come from wells that do not need them (because new high-rate wells dominate volume).

The surface beam of a pumpjack rocks up and down, driving a long string of rods down the well to a positive-displacement plunger pump at the producing interval. On each upstroke the pump lifts a few gallons of fluid into the tubing; on the downstroke it resets. A single pumpjack may cycle 8 to 15 strokes per minute, 24 hours a day, for decades.

Secondary Recovery: Waterflooding

Secondary recovery involves injecting water or gas to maintain reservoir pressure and physically sweep oil toward producing wells. Waterflooding is by far the most common method: seawater, produced water, or treated river water is injected at high pressure through dedicated injection wells, raising pressure and pushing oil through the pore network toward producers. Waterflooding has been used from the earliest production stages at Saudi Arabia's Ghawar, where the resulting pressure support has kept the giant field producing for over 70 years. Injection patterns are chosen to maximize sweep efficiency across a regular well grid. The two classic patterns are the five-spot (one producer in the center of a square of four injectors, with every well in the grid serving one of the two roles) and the nine-spot (one producer surrounded by eight injectors in a 3-by-3 grid). Direct line drive, inverted patterns, and irregular patterns are used in fields where faults or permeability contrasts make the classical grids inefficient.

Tertiary Recovery: Enhanced Oil Recovery

Tertiary recovery, better known as Enhanced Oil Recovery (EOR), uses advanced techniques after primary and secondary methods have exhausted the easy oil. EOR methods are grouped into three families by the physics they exploit: thermal (change viscosity with heat), gas (change miscibility with solvents), and chemical (change sweep with surfactants or polymers).

Decline Curves and Field Life

Every oil well follows a decline curve: production peaks early then gradually falls as reservoir pressure depletes. Conventional wells typically decline 5 to 15 percent per year. Shale wells are drastically steeper: 60 to 80 percent decline in the first year, 30 to 40 percent in the second year, then a long low-rate tail. This difference dominates the economics. A conventional well in the Middle East may produce for 30 years with modest intervention. A shale well delivers most of its lifetime oil in the first 24 months, requiring continuous new drilling just to hold field-level production flat, a phenomenon the industry calls the shale treadmill.

Field operators use decline curve analysis (DCA) to forecast future production and estimate ultimate recovery. The three standard Arps models are exponential (constant percentage decline, fits most mature conventional wells), hyperbolic (a slowing decline rate, fits wells with strong transient flow), and harmonic (the slowest decline, a special case of hyperbolic with b equal to 1). The widget below lets you see how changing the hyperbolic b-factor rotates the curve and reshapes estimated ultimate recovery from the same initial rate. Chapter 14 (Reserves) goes deeper into how decline curves feed proved reserve bookings and SEC PV-10 valuations.

The chart below compares a typical shale horizontal well against a conventional vertical well, both starting at 1,000 barrels per day. The shale well loses two thirds of its rate in year one; the conventional well barely moves. This is why shale economics are driven by initial rate, completion cost, and drilling pace rather than long-term recovery per well. See Chapter 21 (The Shale Revolution) for the full treatment of how horizontal drilling and hydraulic fracturing changed the industry.

Offshore Production

When onshore opportunities are limited, companies move offshore, where costs are 4-5 times higher but fields tend to be much larger. Offshore platforms fall into a tidy typology defined primarily by water depth. Fixed structures dominate shallow water; floating systems dominate deepwater and ultra-deepwater. The choice of platform type has first-order consequences for capex, schedule, and even the commercial structure of the development.

Brazil's pre-salt fields (discovered 2006-2007) lie beneath 7,000 feet of water, 10,000 feet of rock, and a 6,000-foot layer of salt, yet are developed with arrays of FPSOs tied back to dozens of subsea wells and produce over 3 million bpd in aggregate. The US Gulf of Mexico produces roughly 1.8 million bpd from a mix of fixed jackets on the shelf and deepwater TLPs, spars, and semi-submersibles. The 2010 Deepwater Horizon disaster (the Macondo blowout, discussed in the well control section above) led to stricter safety regulations and a temporary drilling moratorium, but Gulf deepwater production has since recovered and grown.

The Shale Revolution

Horizontal drilling combined with hydraulic fracturing ("fracking") took US oil production from 5 million bpd in 2008 to roughly 13.5 million bpd by 2025, making the US the world's largest oil producer. The mechanics belong in their own chapter. The five-step fracking explainer below introduces the core idea; Chapter 21 (Shale Revolution) covers basin geology, rig productivity, type curves, the 2015 crude export ban lift, and the 2023 to 2025 consolidation wave (ExxonMobil to Pioneer, Chevron to Hess, Diamondback to Endeavor).