FIFO (electronic)

In digital electronics, a FIFO (acronym for first-in, first-out) is a digital circuit that stores incoming data in internal memory and outputs the stored data in the order it was received. Data is stored on demand and the oldest stored data is output on demand, with both operations occurring independently and at potentially different rates. This is in contrast to a shift register, which requires data to be concurrently stored and output, and for the oldest data to sequentially propagate through memory before it is output.

A FIFO primarily consists of a pair of counters that serve as read and write memory address registers, an addressable memory array, and status and control logic. The memory is dual-ported to allow concurrent FIFO read and write operations, and typically consists of a register file or dual-ported RAM (random access memory).

The data written to and read from a FIFO typically have a fixed word size (number of bits) equal to that of the internal memory, commonly referred to as the FIFO width. The maximum number of words that can be stored in the FIFO is known as the FIFO depth. Although it is not required, the depth is usually an integer power of two, as this tends to simplify circuitry and improve speed performance. Together, the width and depth determine the storage capacity of a FIFO.

FIFOs are used to exchange data between two hardware devices or between a hardware device and software. They are commonly used to exchange data between circuits that operate in different clock domains, and for buffering and flow control between data producers and consumers which, over finite intervals, operate at different data rates.

Interface ports

A FIFO has two electrical interfaces known as the write port and read port, through which it exchanges data and status information with external circuits.

The external circuitry consists of a data producer that stores data in the FIFO and a data consumer that fetches the stored data. More specifically, the producer sends data to and receives status information from the write port, and the consumer receives both data and status from the read port.

Clock domain

Each port operates in the clock domain of the external circuit it is connected to, meaning that the port and external circuit share a common clock signal. The write port operates in the producer's clock domain and thus all write port signals are synchronized to the producer's clock. Similarly, the read port operates in the consumer's clock domain.

FIFO types

Every FIFO is categorized as either synchronous or asynchronous.

Synchronous FIFO

A synchronous FIFO is an electronic FIFO that uses a common clock for the read and write ports. Because read and write operations take place in the same clock domain, all status signals (buffer level, threshold flags) can be shared by the read and write ports.

Asynchronous FIFO

An asynchronous FIFO is an electronic FIFO that uses different clocks for the read and write ports.

To avoid errors due to metastability, a dedicated set of status signals (buffer level, threshold flags) is output for each clock domain. The circuitry used to circumvent metastability introduces additional latency (compared to synchronous FIFOs) into status flag updates when data is written to an empty FIFO or read from a full FIFO.

Memory address registers

A FIFO is implemented as a circular buffer that employs two memory address registers (MARs) to store the addresses of (pointers to) the next memory locations to be accessed. The read MAR (RMAR) indicates the next location that data will be read from, and the write MAR (WMAR) indicates the next location that data will be written to. Each MAR is associated with a particular port, and thus operates in that port's clock domain.

• Schematic excerpt of a basic synchronous FIFO. The memory address registers (MARs) consist of binary counters that directly output memory addresses WADDR and RADDR, which designate the next words to be written to and read from memory.

Each MAR is implemented as a counter, with the count incremented every time data is transferred (WMAR incremented upon FIFO write; RMAR incremented upon FIFO read). Initially both MARs point to the first memory location and the FIFO is empty. A FIFO becomes full when the write address reaches the read address, and empty when the read address reaches the write address. When the MAR addresses the last location in memory, it will automatically roll over to the first memory address upon the next increment.

For any particular FIFO, the MARs may be implemented as either binary or Gray code counters. Binary counters are usually preferred in synchronous FIFOs, as this simplifies the FIFO circuitry. Gray code counters, or Gray code-encoded binary counters, are used in asynchronous FIFOs to avoid errors due to metastability.

Status signals

Buffer level

Many FIFOs output a binary value that indicates the current buffer level (number of words stored). Depending on its design, a FIFO may do this by either tracking the level with a counter or computing the level using pointer arithmetic. Synchronous FIFOs may use either method, whereas asynchronous FIFOs are restricted to using pointer arithmetic.

Tracking via counter

In a synchronous FIFO, the buffer level may be monitored by tracking it with a bidirectional binary counter. The count is incremented when data is written to the FIFO, and decremented when data is read. The binary count value output by the counter directly indicates the buffer level.

This method is not suited to asynchronous FIFOs because the read and write ports operate in different clock domains, which would require the counter to be controlled by two different clocks.

Calculation via pointer arithmetic

In asynchronous FIFOs, and in many synchronous FIFOs, the buffer level is calculated from the current memory addresses. This is easily done when the FIFO is neither empty nor full because the level is equal to the difference between the write and read addresses. However, when the FIFO is empty or full, the addresses are equal and thus would be ambiguous if used to compute level. Consequently, to distinguish between empty and full, it is common for each MAR to have one additional bit beyond what is needed to address memory. The resulting extended address (XADDR) is used to compute the FIFO level, while all bits of XADDR other than the most significant bit (MSB) (i.e., the LSBs) serve as the memory address.

In general, a MOD-n {\displaystyle n} counter (a counter with n {\displaystyle n} distinct output states) is used for a FIFO memory that can store n / 2 {\displaystyle n/2} data words. For example, a MOD-32 MAR is used to generate addresses in a FIFO having a 16-word memory.

In cases where the MARs are binary counters, the buffer level is the difference between the MAR output values: l e v e l = W M A R − R M A R {\displaystyle level=WMAR-RMAR}. For other output encodings (e.g., Gray code), the MAR outputs must be converted to binary before computing the difference. In either case, the difference is typically calculated by a MOD-n {\displaystyle n} binary subtractor, with any resulting arithmetic borrow (i.e., carry out) discarded.

Buffer threshold flags

A FIFO outputs individual status signals (flags) that indicate whether particular data level thresholds are met. All FIFOs output full and empty flags, and some may also output additional flags such as half full, almost full, and almost empty.

Status signals may be generated by directly comparing the synchronized read and write addresses or, if available, from the FIFO level. In the latter case, status signals are derived from the FIFO level via combinational logic or, in the case of full, by extracting the MSB. Depending on the FIFO design, the thresholds for almost full and almost empty flags (if implemented) may be application-specific constants or they may be programmable.

• Schematic diagram showing derivation of common threshold status flags. The level generator may be implemented as a binary subtractor performing pointer arithmetic, or as a level-tracking bidirectional counter.
• Programmable threshold detectors used to generate almost empty and almost full flags. Threshold levels are defined by the binary values applied to the magnitude comparator inputs.

Usage

The FIFO status flags are used to notify the external data producer and consumer that critical thresholds have been reached. Typically the producer and consumer will respond to such notifications by suspending or resuming FIFO writing and reading, respectively. The producer or consumer (or both) may be a processor that polls status or receives status via interrupts, or it may be a purely hardware entity that uses the status signals to manage flow control.

In many FIFOs, the full and empty flags are used internally to qualify the write enable and read enable signals. Writing is inhibited when full is asserted: data is not written to memory and the write MAR is not incremented. Similarly, reading is inhibited when empty is asserted: the read MAR is not incremented, and typically the previous read data is output.

Address synchronization

In FIFOs that compute buffer level via pointer arithmetic, the read and write addresses must be synchronized to a common clock to ensure stable inputs for the binary subtractor. This requirement is inherently satisfied in synchronous FIFOs because read and write ports use the same clock. However, asynchronous FIFOs use different clocks for read and write ports, and consequently the buffer level must be independently calculated for each port in its own clock domain. This requires the current address of each port to be synchronized to the other port's clock, a process known as clock domain crossing.

Clock domain crossing is typically implemented by sequentially passing a port's current address through a series of two or more registers that are clocked by the other port. The first register synchronizes the address to the other port's clock, and subsequent register(s) mitigate any resulting metastability.

Gray code encoding

When incremented, a binary address will in many cases change by multiple bits at the same time (e.g., from 0111 to 1000}. If the changing bits happen to be sampled too close to the moment they change (and thereby violate the sampling register's setup or hold time), some may be sampled at their previous state and others at their new state, thus producing an invalid address in the destination clock domain which matches neither the previous nor the new address. When this happens, the buffer level calculated in the other clock domain will be incorrect.

To prevent such errors, the address is sent to the other clock domain as a Gray code value. Since every address increment changes only one Gray code bit, the address received by the other clock domain is guaranteed to match either the previous or new address if sampled when the bit is changing.

In some FIFOs this is done by implementing the MAR as a Gray code counter that directly outputs Gray code addresses, as shown below:

Alternatively, a MAR with binary encoded outputs may be used in conjunction with a binary-to-Gray code converter. This requires the converter output to be reclocked before it crosses clock domains, to eliminate Gray code glitches caused by binary bits changing at different times.

Address processing

Each port sends its MAR address to the other port and receives the other port's address in Gray code via a clock domain synchronizer. Within each port, the received address is converted to binary and used to generate the buffer level and status flag signals in the port's clock domain. In FIFOs that use Gray code MARs, this is typically implemented as shown below:

Overflow

An overflow will occur if the data producer (writer) writes to a FIFO whose memory is full. If such a write is allowed to proceed normally, the new data word will overwrite the oldest stored word and, in the process, the write pointer (value output by the write MAR) will lap the read pointer, thus corrupting the FIFO level and making it appear that the FIFO contains only one word. To avoid this, FIFOs are usually designed to maintain the correct FIFO level by dropping (discarding) either the new word or the oldest stored word. In either case, a notification signal is usually output to inform the writer that data was lost.

Mitigation by blocking

Upon impending overflow, the new data word may be dropped by blocking FIFO writes. This is typically implemented by gating the FIFO's write enable with the full flag as shown below. In such implementations, the full flag indicates that the buffer will not accept new data. This circuit operates solely in the write port's clock domain and therefore is suited to both synchronous and asynchronous FIFOs.

• Typical circuit used to block writes when FIFO memory is full. A second gate outputs OVERFLOW to notify the writer that the write failed.

Mitigation by overwriting

Alternatively, upon impending overflow, memory may be reallocated for the new data word by dropping the oldest stored word and reusing its memory location. This is done by writing the new word as usual (thus overwriting the oldest stored word) while concurrently incrementing the read MAR. Since both MARs are simultaneously incremented, the apparent buffer level remains unchanged. Both MARs are incremented by the write port clock; consequently this process is not suitable for asynchronous FIFOs, which require the read MAR to be incremented in the read port's clock domain.

Applications

Clock domain crossing

Many systems are composed of multiple logic circuits, each operating in a different clock domain, which must communicate with one another. To achieve this, every such circuit must exchange data with a circuit that is operating in a different clock domain. However, sending data directly to another clock domain is unreliable, because doing so could result in data corruption due to metastability. This problem is avoided by passing the data through an asynchronous FIFO, which eliminates metastability and thus ensures the integrity of the conveyed data.

• An asynchronous FIFO used to reliably send data from one clock domain to another. The data producer (circuit A) and consumer (circuit B) operate in clock domains CLKA and CLKB, respectively. Signal directions are left to right unless otherwise indicated by arrows.

See also

• Leaky bucket approach

Notes