NIO Concepts: Difference between revisions

From NovaOrdis Knowledge Base
Jump to navigation Jump to search
No edit summary
 
(40 intermediate revisions by the same user not shown)
Line 6: Line 6:
=Overview=
=Overview=


NIO (Non-blocking IO) was introduced in Java 4 and enhanced with new File operations as NIO.2 in Java 7.  
NIO (Non-blocking IO) was introduced in Java 4 and enhanced with new File operations as NIO.2 in Java 7. The major improvement introduced by NIO was to allow [[#Non-Blocking_I.2FO|non-blocking]], block-oriented I/O operations from Java programs. Somewhat unrelated, NIO offers new features such as [[#File_Locking|file locking]] and [[#Character_Sets|characters sets]], and NIO.2 comes with a new [[#NIO_2_File_API|file system access API]].


The major improvement introduced by NIO was to allow non-blocking, block-oriented I/O operations from Java programs.
=<span id='Multiplexed_Non-Blocking_I.2FO_Facility'></span><span id='Selector'></span><span id='Selector_Key'></span><span id='Selectable_Channel'></span><span id='Stream-Oriented_vs._Block-Oriented_I.2FO_Operations'></span><span id='Channel'></span><span id='Buffer'></span><span id='Channel.2FBuffer_Interaction'></span>Non-Blocking I/O=


Until NIO, all that was available for I/O were Streams (<tt>java.io.*</tt>), and all operations with Streams are blocking: a thread waits until there is data to read from the Stream instance or until it can write to the Stream instance, so simultaneously handling multiple sources of data (concurrent network connections, for example) required multiple threads that would usually spend most of their time blocked waiting on I/O events. This is the I/O and threading model Tomcat is built on. NIO  (<tt>java.nio.*</tt>) offers access to underlying O/S non-blocking I/O facilities and offers a [[#Selector|selectors]] mechanism through which a single thread could be notified and process I/O events arriving from multiple sources.
{{Internal|Java Non-Blocking I/O Concepts#Overview|Java Non-Blocking I/O Concepts}}
 
Also, because the underlying operating system I/O facilities are block-oriented for efficiency - hardware usually transfers data in blocks rather than byte by byte - NIO exposes block-level access via [[#Channel|Channels]] and [[#Buffer|Buffers]]. Data can be read and written in blocks via Buffers into and from Channels. Streams only offer sequential access - once a byte has been read, it is gone from the Stream and it is the application's responsibility to cache it locally if it needs it later. With Buffer, the caching is already done, efficiently, by the O/S.
 
Channels are also sources of asynchronous I/O events that are routed by selectors into the application. The data transfer between Channels and Buffers is done transparently, without requiring application threads to move bytes around. An application thread is notified once the transfer had completed via an I/O event. The NIO API does not do anything that the Stream API can't do - essentially reading and writing data from/to I/O devices - but it does it faster and using less threads.
 
Block-access and non-blocking I/O read and write allow Java applications to implement high-speed I/O without having to write native code that would access O/S specific facilities.
 
Somewhat unrelated, NIO offers new features such as [[#File_Locking|file locking]] and [[#Character_Sets|characters sets]], and NIO.2 comes with a new [[#NIO_2_File_API|file system access API]].
 
=Stream-Oriented vs. Block-Oriented I/O Operations=
 
A stream-oriented I/O system deals with data one byte at a time: an input stream produces a byte of data and an output stream consumes a byte of data. Stream-oriented API allow data to be easily filtered. They also allow multiple streams to be easily chained. However, moving data this way is rather slow. A block-oriented I/O system deals with data in blocks - each operation produced or consumes a block of data in one step. This could move data faster, but the block-oriented APIs lack the elegance and simplicity of the stream-oriented APIs.
 
=Multiplexed Non-Blocking I/O Facility=
 
[[#Selector|Selectors]], [[#Selection_Key|selection keys]] and [[#Selectable_Channel|selectable channels]] work together to provide a multiplexed, non-blocking I/O facility, whose main advantage is that is much more scalable than thread-oriented blocking I/O. The facility works as follows: a Selector instance is created using the [https://docs.oracle.com/javase/10/docs/api/java/nio/channels/Selector.html#open() Selector.open()] static method.
 
==Selector==
 
==Selection Key==
 
==Selectable Channel==
 
=Channel=
 
A Channel represents an open connection to an entity such as a hardware device, a file, a network socket or a program component that is capable of performing I/O operations. The Channel is essentially a source of I/O events. The application does not read or write data from/to the Channel directly, it does so via [[#Buffer|Buffers]], after being notified of data availability via a [[#Selector|selector]]. For more details se [[#Channel.2FBuffer_Interaction|Channel/Buffer Interaction]] below.
 
For more details about Channels see:
 
<blockquote style="background-color: #f9f9f9; border: solid thin lightgrey;">
:[[NIO Channels]]
</blockquote>
 
=Buffer=
 
<tt>java.nio.Buffer</tt> is a container for a fixed amount of data. More details on Buffers is available in:
 
{{Internal|NIO Buffer Mechanics|NIO Buffer Mechanics}}
 
=Channel/Buffer Interaction=
 
==Reading from a Channel==
 
To read from a channel use:
 
<pre>
ReadableByteChannel channel = ...;
ByteBuffer buffer = ...;
channel.read(buffer);
</pre>
 
The invocation of the <tt>read()</tt> method initiates an attempt to transfer data from the channel into the buffer. The read operation might not fill the buffer, and it fact might not read any bytes at all - if none are available on the channel. In the best case, it fills all the space available in the buffer. The result is the number of bytes read, possibly zero, or -1 if the channel has reached end-of-stream. The buffer's internal accounting variables are modified correspondingly.
 
If the channel is in blocking mode, the method will block until at least one byte is read.
 
Also see https://docs.oracle.com/javase/8/docs/api/java/nio/channels/ReadableByteChannel.html


=File Locking=
=File Locking=
Line 80: Line 24:
</blockquote>
</blockquote>


=NIO 2 File API=
=NIO 2=
 
{{Internal|Java NIO 2|Java NIO 2}}
<blockquote style="background-color: #f9f9f9; border: solid thin lightgrey;">
:[[NIO 2 File API]]
</blockquote>

Latest revision as of 22:03, 18 June 2020

Internal

Overview

NIO (Non-blocking IO) was introduced in Java 4 and enhanced with new File operations as NIO.2 in Java 7. The major improvement introduced by NIO was to allow non-blocking, block-oriented I/O operations from Java programs. Somewhat unrelated, NIO offers new features such as file locking and characters sets, and NIO.2 comes with a new file system access API.

Non-Blocking I/O

Java Non-Blocking I/O Concepts

File Locking

NIO File Locking

Character Sets

NIO Character Sets

NIO 2

Java NIO 2
Retrieved from "https://kb.novaordis.com/index.php?title=NIO_Concepts&oldid=67505"