SongketMail Sdn Bhd (1243508-A), An ICT Service Delivery and Operation (ISDO) Company

SongketMail Sdn Bhd (1243508-A), An ICT Service Delivery and Operation (ISDO) Company


SongketMail Sdn Bhd (1243508-A) is an Information Technology systems Integrator and Open Source Software consulting. SongketMail is focusing on ICT Service Delivery and Operation (ISDO), ICT Security related to ISDO, Data Center Agility and Cloud Computing base on Open Source Software and solution. We enable our customers based in the Government, Education and Private sectors to deliver agility, secure and success in their cloud computing, DevOps automation, and Open Source Software related projects.


SongketMail

019-6085482 (Harisfazillah Jamel / LinuxMalaysia)




Catatan Pertama Haris Di Blogspot

Assalamualaikum,

Ini adalah catatan pertama Haris dalam menggunakan laman ini untuk mencatatkan pengalaman Haris sepanjang hari mengendalikan komputer dan Internet. Diharapkan catatan dan nota ini dapat dijadikan satu pengkongsian pengalaman untuk semua.

Wassalam.


http:// hafnie .cjb .net /


=== Dibawah adalah nota untuk kemasan pada 7 Jan 2018 ===

Ini adalah catatan pertama dalam Blog ini. Sekadar hendak kemaskan link cjb dot net agar link dimatikan. CJB sudah tiada lagi sebagai fowading URL.

Tarikh sebelum update URL ini

08/01/2002 20:36 MYT. Tidak pasti Jan atau Ogos. :-) Bila tekan Publish On rupanya 8 Januari 2002. Tukarkan Published on kepada automatik untuk jadikan post lepas kemas kini ke depan post dan gunakan tarikh sekarang.

Bagi yang berminat dengan Google Shortner URL ini adalah contoh untuk link blog post ini

https://goo.gl/3JSTSL

Atau buat untuk anda sendiri  di 
https://goo.gl/

Persediaan Docker Production Ubuntu 16.04 Untuk Storage Driver Overlay2

Persediaan Docker Production Ubuntu 16.04 Untuk Storage Driver Overlay2

Tujuan :-

Untuk menggunakan partition berasingan untuk /var/lib/docker dan Overlay2 sebagai Storage Driver.

Pastikan :-

Hanya lakukan pada pemasangan docker CE yang baru sahaja.
Pastikan dahulu partition hardisk baru telah dibuat.


1) sudo fdisk /dev/vdb

create vdb1

n p w

(vdb adalah volume dalam OpenStack)
(akan berbeza bagi setiap sistem)


2) Buat fail sistem xfs (system file creation)

sudo mkfs.xfs /dev/vdb1


3) labelkan (filesystem label)

sudo xfs_admin -L dockerstore /dev/vdb1


4) Hentikan docker

sudo systemctl stop docker



5) Buat backup directory /var/lib/docker

sudo cp -au /var/lib/docker /var/lib/docker.bk



6) delete isinya

rm -rf /var/lib/docker/*

(hati-hati dengan * star - jangan ada ruang)
(disengajakan tiada sudo. Sila tambah)


7) Masukkan dalam /etc/fstab

LABEL=dockerstore /var/lib/docker        xfs    defaults        0 0


8) mount filesystem tersebut

sudo mount /var/lib/docker


9) Periksa dengan  sudo df -h


Contoh hasil :-

/dev/vdb1       1.0T   33M  1.0T   1% /var/lib/docker


10) Periksa overlay2 adalah default storage driver dengan arahan (Hanya disokong dalam kernel Linux versi 4.0 dan keatas)

docker info

Hasil output yang dicari adalah

Storage Driver: overlay2


11) Edit fail

/etc/docker/daemon.json

Isinya

{
  "storage-driver": "overlay2"
}


12) Mulakan docker

sudo systemctl start docker


13) Periksa isi /var/lib/docker pastikan ada isinya

[email protected]:~# ls /var/lib/docker
builder  containerd  containers  image  network  overlay2  plugins  runtimes  swarm  tmp  trust  volumes

14) docker info

Output yang dicari

Storage Driver: overlay2
 Backing Filesystem: xfs


15) Periksa juga /var/lib/docker/overlay2 selepas download container


16) Untuk memudahkan pembesaran saiz partition, boleh gunakan LVM. Pastikan gunakan GPT untuk harddisk lebih 2TB


Rujukan :-


https://docs.docker.com/engine/userguide/storagedriver/overlayfs-driver/#configure-docker-with-the-overlay-or-overlay2-storage-driver

https://liquidstate.net/using-disk-labels/

https://www.cyberciti.biz/tips/fdisk-unable-to-create-partition-greater-2tb.html

https://www.digitalocean.com/community/tutorials/how-to-install-and-use-docker-on-ubuntu-16-04


Nota oleh : Harisfazillah Jamel

[email protected]

5 Jan 2018

PS. Bagi Redhat / Centos 7 dan Fedora arahan yang digunakan adalah :-

container-storage-setup

Dan dengan Storage driver devicemapper

ElasticSearch Cluster, Logstash And Kibana (ELK5) installation on Linux CentOS 7 - Logstash Installation - Page 4

Install logstash 5



  1. Download and install the public signing key (ignore this if you have imported the same key during other package installation):
# rpm --import https://artifacts.elastic.co/GPG-KEY-elasticsearch
  1. Add below lines to sources.list to /etc/yum.repos.d/logstash.repo:
[logstash-5.x]
name=Elastic repository for 5.x packages
baseurl=https://artifacts.elastic.co/packages/5.x/yum
gpgcheck=1
gpgkey=https://artifacts.elastic.co/GPG-KEY-elasticsearch
enabled=1
autorefresh=1
type=rpm-md
  1. Install logstash:
# yum -y install logstash
  1. Set logstash to start automatically using systemd:
# systemctl daemon-reload && systemctl enable logstash.service
  1. Stop and start logstash:

# systemctl stop logstash.service && sudo systemctl start logstash.service


Prepared by :
Hisham Aderis ([email protected])
Harisfazillah Jamel ([email protected])


Date : 2 Dec 2016
Last updated: 31 August 2017

ElasticSearch Cluster, Logstash And Kibana (ELK5) installation on Linux CentOS 7 - ElasticSearch Installation - Page 3

Install elasticsearch 5

  1. Add key:
# rpm --import https://artifacts.elastic.co/GPG-KEY-elasticsearch
  1. Add elasticsearch.repo. Using text editor, add below lines to /etc/yum.repos.d/elasticsearch.repo:
[elasticsearch-5.x]
name=Elasticsearch repository for 5.x packages
baseurl=https://artifacts.elastic.co/packages/5.x/yum
gpgcheck=1
gpgkey=https://artifacts.elastic.co/GPG-KEY-elasticsearch
enabled=1
autorefresh=1
type=rpm-md
  1. Install elasticsearch:
# yum install elasticsearch -y
  1. Set elasticsearch to start automatically using systemd:
# systemctl daemon-reload && systemctl enable elasticsearch.service
  1. Set hostname to be resolved locally using /etc/hosts. Use DNS if you have one:
# cat /etc/hosts
192.168.10.10 node1
  1. Bind hostname to elasticsearch, by uncommenting below line in /etc/elasticsearch/elasticsearch.yml. The node name can be anything to your liking, but must be similar to the one set in step 5:
network.host: node1
  1. Set bootstrap memory lock to be true in /etc/elasticsearch/elasticsearch.yml
bootstrap.memory_lock: true
  1. Set maximum number of memory bytes that may be locked into RAM in /usr/lib/systemd/system/elasticsearch.service, by uncommenting below line
LimitMEMLOCK=infinity
  1. Reload systemctl
# systemctl daemon-reload
  1. Set java heap size for elasticsearch to use in /etc/sysconfig/elasticsearch(rule of thumb, use ½ of your physical memory. In this example 2GB for system with 4GB):
ES_JAVA_OPTS="-Xms2g -Xmx2g"
MAX_OPEN_FILES=65536
MAX_LOCKED_MEMORY=unlimited
  1. The config file will look like below:
# grep -v ^# /etc/sysconfig/elasticsearch | grep -v ^$
ES_JAVA_OPTS="-Xms2g -Xmx2g"
MAX_OPEN_FILES=65536
MAX_LOCKED_MEMORY=unlimited
  1. Set file limits for elasticsearch in /etc/security/limits.conf (this change needs reboot for the change to take effect):
elasticsearch - nofile 65535
elasticsearch - memlock unlimited
  1. The config file will look like below:
# grep -v ^# /etc/security/limits.conf | grep -v ^$ | tail -5
elasticsearch - nofile 65535
elasticsearch - memlock unlimited
  1. Reboot the machine
# reboot
  1. Stop & start elasticsearch:
# systemctl stop elasticsearch.service && systemctl start elasticsearch.service
  1. Test whether elasticsearch is running, output should be something like below:
# curl -XGET node1:9200/?pretty
{
"name" : "Cp8oag6",
"cluster_name" : "elasticsearch",
"cluster_uuid" : "AT69_T_DTp-1qgIJlatQqA",
"version" : {
"number" : "5.0.0",
"build_hash" : "f27399d",
"build_date" : "2016-03-30T09:51:41.449Z",
"build_snapshot" : false,
"lucene_version" : "6.2.0"
},
"tagline" : "You Know, for Search"

}

Prepared by :
Hisham Aderis ([email protected])
Harisfazillah Jamel ([email protected])


Date : 2 Dec 2016
Last updated: 31 August 2017

Popular Posts

Labels

64bit Activity Adempire advocate Akta Apache ASAS Azam backup backuppc Bash Beowulf Big Data Broadband Budget Centos Cinta Cluster CMS cmsfornerd Company Complain computer Computer Operation Conference Contest Data Centre Operation DBmail Digg Digital Certification Discussion Group Django DNS Docker Domain Duit Online Economy Elasticsearch ELK email email server English Evangelist Events Family Tree Fedora File System Firefox Foss FOSS.my FreeBSD FTX Gluster Gmail Godaddy.com Google Google App GTUG Hacking Hadoop hafnie Harisfazillah Jamel horde HP-UX hwclock IBM ICT Service Delivery and Operation Indonesia Internet Internet Tools Itanium Jaring Java Javascript Jepun Jiwang Joke Joomla Kesihatan Kibana KOSTEM ldap Linux Linux Counter linuxmalaysia Logstash Love Mailman MailScanner Mailwatch Malay Malaysia MAMPU MDeC meetup Melaka Melayu Merdeka Microsoft Migration mirror sites Money Online MOSC 2010 MOSC2010 mosc2011 MOSC2013 MOSCMY MOSCMY2014 MOSCMY2015 Mozilla MPI MSC Malaysia MSC Malaysia OSCONF MSCOSCONF My Love MyGOSSCON MyMeeting Mypenguin99 mysql Nagios NagiosQL Negaraku nss_ldap ntp OBW2014 Open Office Open Source openldap Openoffice.org OpenStack Opera OS2 OS400 OSCC OSCC MAMPU osdc.my OSS OSS Policy OWASP Parallel Computing People Power Personal PGP PHP Pligg Politik Postfix Postgresql Programming Proxmox Python q1moscmy2015 Questionnaires Research Research tools RPM SASSIAN Sassian 85-89 Sassians 85-89 SCO Security Sekolah Sekolah Alam Shah Shell script Software License Solaris SongketMail SongketMailFilter sourceforge spam spamassassin Spoof Survey SVR4 System Tools Technorati Terjemahan Terminal TMnet Training translation Treasury Malaysia Trend Micro Twitter Ubuntu Unix Virtualization VMS VOIP Wang Web Server Windows Zimbra