MQTT:-

Software environment:-

1.mosquitto broker & clients

==> Download source code of latest version from http://mosquitto.org/

==> Extract in suitable workdir

tar -zxvf mosquitto-1.4.11.tar.gz
cd mosquitto-1.4.11
mkdir build && cd build
cmake .. #fix missing dependencies,eg:- ssl,c-ares
make
make install #sudo

==> For mosquitto installed thru apt-get

sudo service mosquitto start #status, stop
sudo systemctl start mosquitto #status, stop

==> Run custom broker,built by source

/usr/local/sbin/mosquitto -d
/usr/sbin/mosquitto --version
/usr/local/sbin/mosquitto --version

ls /usr/local/bin
ls /usr/local/sbin
ls /usr/local/include
ls /usr/local/lib

ps -aux | grep mosquitto

ps -el | grep mosquitto
netstat -ntpl

2.Build paho client library

Download source tarball/zip file(v1.1.0) from
github.com/eclipse/paho.mqtt.c/
(or)
git clone https://github.com/eclipse/paho.mqtt.c.git
cd paho.mqtt.c
git checkout -b 1.1.0

make
make install #sudo
#observe generated libs,header files in /usr/local/lib, /usr/local/include

3.Wireshark

sudo apt-get install wireshark

To run wireshark as local user:-

Ref:- https://wiki.wireshark.org/CaptureSetup/CapturePrivileges

sudo setcap 'CAP_NET_RAW+eip CAP_NET_ADMIN+eip' /usr/bin/dumpcap

sudo usermod -a -G wireshark $USER
#logout and login

(or)
build from sources
Download latest tarball from wireshark.org & extract
tar -jxvf wireshark-2.2.6.tar.bz2
cd wireshark-2.2.6
./autogen.sh #if cloned from git repo,else skip
./configure #--prefix=/opt/wireshark
make
make install
(or)
mkdir build && cd build
../configure
make
make install
==========================
Setup HiveMQ..latest version (limited edition)

Extract the tarball/zip file

Run the startup script from bin directory
Protocol:-

*** Download the official specs(OASIS) from mqtt.org ***

==> Publish-subscribe mechanism, mapping done thru
topic names
==> topic names can be hierarchial, wild cards(+,#) allowed
on subscriber side
==> Works on TCP transport layer by default...TLS/SSL are possible
==> Broker runs on port no.1883

==> Packet Structure

* Binary encoding
* Comes with min two bytes for essential header
for payload upto 127 bytes
* Max size of essential header is 5 bytes (1 + 4)
Analyze Packet Flow:-

==> Start wireshark..choose suitable interface, apply filter "mqtt"

colorization rules
View ==> Colorinf rules
tcp.srcport==1883
tcp.dstport==1883
==> Some client operations
mosquitto_sub -t hello
mosquitto_pub -t hello -m abcd
##CONNECT,CONNACK,PUBLISH,SUBSCRIBE,SUBACK, PINGREQ,PINGRESP
==> Retain flag
mosquitto_pub -t hello -m abcd -r
mosquitto_pub -t hello -m xyz -r
#now run the subscriber and check latest message
##Retain flag set header flags
==> Keep Alive Timer
#check default value in connect packet
# append "-k 30" to any command
# to check ping on publisher
mosquitto_pub -t hello -l #or -s
## timer value in connect packet, in connect flags
==> Client Id
mosquitto_pub -t hello -m abcd -i pubdemo
mosquitto_sub -t hello -m abcd -i subdemo

==> QoS Levels:-

Let's assume subscriber QoS level is 2

Level 0:- At max once, fire and forget

No acknowledgement for the delivered packet

Level 1:- At least once...

PUBACK is delivered in reverse direction
mosquitto_pub -t hello -m abcd -q 1

Level2:- Exactly once

PUBLISH, PUBACK, PUBREL, PUBCOMP
mosquitto_pub -t hello -m abcd -q 1

Downgrading of QoS level in delivered messages to subscriber:-

mosquitto_sub -V mqttv311 -t hello -q 2
mosquitto_pub -V mqttv311 -t hello -m abcd
==> Last Will and Testament

--will-topic death/sub --will-payload "sub is dying"

(or)
--will-topic death/pub --will-payload "pub is dying"

mosquitto_sub -t death/#
(or)
mosquitto_sub -t pubdeath -t subdeath

#you can also use --will-retain, --will-qos

==> Clean session, applicable for subscribers

By default the clean session is true

disable clean session ==> persistence session, in this

all qos:1, qos:2 messages will be stored by sender
and delivered during reconnecting,even without
subscribe (provided same client id is used during
reconnect,and clean session is disabled)
mosquitto_sub -t hello -q 2 -c -i sub.1234
#publish some messages with qos 1 & 2
 #disconenct client..and publish some more(qos>0)
mosquitto_sub -t hello -q 2 -c -i sub.1234 #reconnect

Remaining Length:-
min - 1 bytes, max-4 bytes (2-5 bytes in essential header)
covers additional flags + payload