Professional Documents
Culture Documents
3. Interprocess Communication
Werner Nutt
1
Interprocess Communication
3.1 Principles
1. Principles
2. APIs for UDP and TCP
3. External Data Representation
4. Client Server Communication
5. Group Communication
2
Middleware
Middleware offers an infrastructure that enables
application processes to communicate with each other
Processes issue requests to the transportation layer
(i.e., the application takes the initiative, not the middleware)
Applications access the middleware via APIs, e.g.,
creation and manipulation of sockets
Integration into programming languages
remote procedure call (RPC)
remote method invocation (RMI)
For higher level APIs, data has to be transformed before it
can be shipped (data marshalling)
Protocols for Client/Server Interaction (Request/Reply)
3
Middleware Layers
ISO/OSI
Applications, services 7
4
Characteristics of IPC
5
Assigned Port Numbers
FTP Data 20
Assigned by IANA
FTP Control 21 (= Internet Assigned
SSH 22 Numbers Authority)
Telnet 23
Numbers between 0 and
SMTP 25 1023 are well-known
Domain Name Server 42 ports opening a port
Whois 43 for such numbers
requires privileges
HTTP 80
POP3 110
IMAP4 143
BGP 179
HTTPS 443 can be found
- on the Web
IMAP4 over SSL 993 - in /etc/services
under Linux and MAC/OS
6
Sockets
Characteristics
Endpoint for inter-process communication
Message transmission between sockets
A socket is associated with either UDP or TCP
Sockets are bound to ports
One process can use many ports
Processes dont share sockets (unless for IP multicast)
Implementations
originally BSD Unix, but available in Linux, Windows,
APIs in programming languages (e.g., java.net )
7
Sockets and Ports
agreed port
socket any port
socket
message
client server
other ports
Receive
receive a message on a socket
can be blocking or non-blocking
Broadcast/Multicast
send to all processes/all processes in a group
9
Receive
Receive is usually blocking
destination process blocked until message arrives
most common case
Variations
conditional receive
(continue until receiving indication
that message arrived or finding out by polling)
timeout
selective receive
(wait for message from one of a number of ports)
10
Send in Asynchronous Communication
Characteristics
non-blocking (process continues after the message sent out)
buffering needed (at receive end)
mostly used with blocking receive
efficient implementation
Problems
buffer overflow
error reporting (difficult to match error with message)
Problems
failure and indefinite delay causes indefinite blocking
(use timeout)
multicasting/broadcasting not supported
implementation more complex
1. Principles
2. APIs for UDP and TCP
3. External Data Representation
4. Client Server Communication
5. Group Communication
13
Java API for Internet Addresses
Class InetAddress
uses DNS (Domain Name System)
InetAddress serverAdd =
InetAddress.getByName(www.inf.unibz.it);
throws UnknownHostException
encapsulates details of IP address
(4 bytes for IPv4 and 16 bytes for IPv6)
14
UDP Packet Structure
UDP = User Datagram Protocol
Payload
15
Java API for UDP
Simple send/receive
with messages possibly lost/out of order
Class DatagramPacket
packets may be transmitted between sockets
packets are truncated if too long
provides getData, getPort, getAddress,
getLength
16
Java API for UDP Sockets
Class DatagramSocket
socket constructor
bound to free port if no arg
arguments InetAddress, Port
send a DatagramPacket, non-blocking
receive DatagramPacket, blocking
setSoTimeout (receive blocks for time T and throw
InterruptedIOException)
close DatagramSocket
throws SocketException if port unknown or in use
connect and disconnect (!!??)
setReceiveBufferSize and setSendBufferSize
17
In the Following Example
UDP Client
sends a message and gets a reply
UDP Server
repeatedly receives a request and sends it back to the
client
Port 6789
message
client server
18
See website of textbook for Java code (www.cdk4.net)
UDP Client Example
public class UDPClient{
public static void main(String args[]){
// args give message contents and server hostname
DatagramSocket aSocket = null;
try { aSocket = new DatagramSocket();
byte [] m = args[0].getBytes();
InetAddress aHost = InetAddress.getByName(args[1]);
int serverPort = 6789;
DatagramPacket request = new
DatagramPacket(m,args[0].length(),aHost,serverPort);
aSocket.send(request);
byte[] buffer = new byte[1000];
DatagramPacket reply = new DatagramPacket(buffer, buffer.length);
aSocket.receive(reply);
} catch (SocketException e){System.out.println("Socket: " + e.getMessage());
} catch (IOException e){System.out.println("IO: " + e.getMessage());}
finally {if (aSocket != null) aSocket.close(); }
}}
19
UDP Server Example
public class UDPServer{
public static void main(String args[]){
DatagramSocket aSocket = null;
try {aSocket = new DatagramSocket(6789);
byte[] buffer = new byte[1000];
while(true) {
DatagramPacket request = new DatagramPacket(buffer,
buffer.length);
aSocket.receive(request);
DatagramPacket reply = new DatagramPacket(request.getData(),
request.getLength(), request.getAddress(), request.getPort());
aSocket.send(reply);
}
} catch (SocketException e){System.out.println("Socket: " +
e.getMessage());
} catch (IOException e) {System.out.println("IO: " + e.getMessage());}
} finally {if(aSocket != null) aSocket.close();}
} 20
Socket Primitives for TCP/IP
System Calls Meaning
22
Java API for TCP
Data stream abstraction
enables reliable transfer (send can be blocking)
marshaling/unmarshaling of data
access to TCP parameters:
ReceiveBufferSize, SendBufferSize
Classes Socket and ServerSocket
Socket asks for connection
ServerSocket listens and returns Socket
when contacted
Port numbers
explicit for ServerSocket, transparent for Socket
23
Java API for TCP
Class ServerSocket:
close
24
Java API for TCP
Class Socket:
connect to SocketAddress
getRemoteSocketAddress since that was chosen by
the TCP system on the other side
getInputStream, getOutputStream
use them for reading and writing
which is/may be blocking
DataInputStream, DataOutputStream:
wrapper classes for streams
have methods for marshaling/ unmarshaling
isConnected
close
25
TCP Client Example
public class TCPClient {
public static void main (String args[]) {
// arguments supply message and hostname of destination
Socket s = null;
try{ int serverPort = 7896;
s = new Socket(args[1], serverPort);
DataInputStream in = new DataInputStream( s.getInputStream());
DataOutputStream out = new DataOutputStream(
s.getOutputStream());
out.writeUTF(args[0]); // UTF is a string encoding
String data = in.readUTF();
System.out.println("Received: "+ data) ;
s.close();
} catch (UnknownHostException e){
System.out.println("Sock: "+e.getMessage());
} catch (EOFException e){System.out.println("EOF: "+e.getMessage());
} catch (IOException e){System.out.println("IO: "+e.getMessage());}
} finally {if(s!=null} try {s.close();} catch (IOException e).}
}
26
TCP Server Example
public class TCPServer {
1. Principles
2. APIs for UDP and TCP
3. External Data Representation
4. Client Server Communication
5. Group Communication
29
External Data Representation
The transport layer is only concerned with the (reliable?)
transmission of sequences of bytes
but what about data types and data structures?
Problems:
Integers: 1'complement vs. 2'complement
Real/Float: IEEE 754 standard vs. IBM Mainframes
Byte order in words: big-endianness vs. little-endianness
Nested strucs
30
Little and Big Endians
Common file formats and their endian order are as follows:
Little Endan
BMP bitmaps (Windows and OS/2 Bitmaps)
GIF
QTM (Quicktime Movies)
Microsoft RTF (Rich Text Format)
Big Endian
Adobe Photoshop
JPEG
TIFF (actually both, endian identifier encoded into file)
MacPaint
31
Marshalling and Unmarshalling
Marshalling: Encode data items so that they can be written
onto a stream
Unmarshalling: Read an encoding from a stream and
reconstruct the original items
Needed for transmission and storing data in a file
Examples
CORBA: CDR (= Common Data Representation) for
primitive and structured data types that occur
in remote method invocations
Java: Serialization (applicable to all classes that
implement the interface Serializable, uses reflection
next chapter) 32
Example: Marshalling in CORBA
struct Person{
string name;
string place;
long year
};
33
Marshalling in CORBA (cntd.)
Primitive Types
short, long, string, float, double,
endian order
determined by sender
flagged in each message
Constructed Types
marshalling operations are generated from IDL types
by CORBA interface compiler
34
Marshalling in CORBA (cntd.)
index in notes
sequence of bytes 4 bytes on representation
03 5 length of string
47 "Smit" Smith
811 "h___"
1215 6 length of string
1619 "Lond" London
20-23 "on__"
2427 1934 unsigned long
Why can one reconstruct the original struct from this byte sequence?
35
Example: Serialization in Java
public class Person implements Serializable {
private String name;
private String place;
private Int year;
public Person(String aName, String aPlace, int aYear) {
name = aName;
place = aPlace;
year = aYear;
}
// methods for accessing instance variables
}
interface of
Internet address port number time object number
remote object
1. Principles
2. APIs for UDP and TCP
3. External Data Representation
4. Client Server Communication
5. Group Communication
39
Communication Types
40
Client Server Communication
Typical example of interprocess communication
Based on a request-reply protocol
Most RPC (= Remote Procedure Call) and
RMI (= Remote Method Invocation) systems are
supported by a similar protocol at the message level
Should this be synchronous communication or not?
Client Server
Request
doOperation
message getRequest
select object
(wait) execute
Reply method
message sendReply
(continuation)
42
Client Server Communication
public byte[] doOperation (RemoteObjectRef o, int methodId,
byte[] arguments)
sends a request message to the remote object
and returns the reply
arguments specify the remote object, the method to be invoked
and the arguments of that method
Client Side
public byte[] getRequest ();
acquires a client request via the server port
requestId int
objectReference RemoteObjectRef
44
Request-reply: Questions
Why?
45
Datagram-based RRP
What can go wrong?
46
Interprocess Communication
3.5 Group Communication
1. Principles
2. APIs for UDP and TCP
3. External Data Representation
4. Client Server Communication
5. Group Communication
47
Group Communication
Multicast transmission
a message sent to a specified group of recipients
(as opposed to unicast and broadcast)
Examples
Fault tolerance based on replicated services
requests go to all servers
Spontaneous networking
all nodes of the network receive messages
Better performance through replicated data
the updated data goes to all storing the data
Event notification
Requirements for delivery guarantees differ
48
Two Implementations of Multicast
49
IP Multicast
Multicast groups are specified by an IP address of class D
and a port number (multicast address)
Available only for datagrams (UDP)
Time To Live (TTL) specifies range of the multicast
50
Multicast Protocols
Internet Group Management Protocol (IGMP)
for interaction between host and nearest router
allows hosts to join and leave a multicast address
dynamically
routers query hosts for their group membership
(soft state registration: expires if not confirmed)
Routing within AS (= Autonomous Systems):
for each group, construct a tree connecting the routers
involved in the group
approaches based on distance vector (MDVRP) and
shortest path (MOSPF) technique
Routing across AS
MDVRP and multicast version of BGP (BGMP) 51
Multicast Routing
Scenario:
Multicast hosts,
their attached routers,
and other routers
Approaches:
single shared tree
one source-based
tree for each router
52
Tunneling
Crux: not all routers support multicast
Solution: multicast-enabled routers form a virtual network
(overlay network)
56
References
In preparing the lectures I have used several sources.
The main ones are the following:
Books:
Coulouris, Dollimore, Kindberg. Distributed Systems Concepts and
Design (CDK)
Slides:
Marco Aiello, course on Distributed Systems at the Free University of
Bozen-Bolzano
Andrew Tanenbaum, Slides from his website
CDK Website
Marta Kwiatkowska, U Birmingham, slides of course on DS
57