Latihan Konsep Cluster Dalam Dunia Open Source

Latihan Konsep Cluster Dalam Dunia Open Source


Kenapa perlu Cluster?


Cluster adalah bertujuan menggabungkan perkakasan atau sistem operasi atau perisian bagi mencapai perkara-perkara berikut :-

1. Kestabilan (Perkhidmatan tanpa henti 24x7)
2. Prestasi (Guna sama CPU, memori dan ruang cakera keras)
3. Keselamatan (Backup dan Redundancy)

Jenis-jenis Cluster


1. Perkakasan
2. Perisian

Cluster perkakasan adalah gabungan dua atau lebih perkakasan bagi membentuk gabungan sistem komputer yang berkongsi sumber seperti CPU, memori,network dan ruang cakera keras. Contoh perisian-perisian untuk tujuan ini adalah Proxmox dan OpenStack.

Cluster perisian adalah perisian yang mempunyai fungsi clusters bina dalam tanpa perlu melalui sistem operasi.

Perkara penting bagi Cluster adalah capaian Network yang baik dan laju.

Tujuan Latihan


Memperkenalkan perisian-perisian sumber terbuka yang boleh digunakan bagi membentuk sistem cluster yang stabil, selamat dan berprestasi tinggi.

Peringkat Pelaksanaan


A. Sistem Operasi (OS)
    Penggunaan Promox sebagai base OS bagi contoh pelaksanaan clusters.
      1. Proxmox
         * https://www.proxmox.com/en 
      2. OpenStack (Demo)
         * https://www.openstack.org 

B. Files System
   1. Glusterfs
      i. Glusterfs
         * http://www.gluster.org  


C. Pangkalan Data
   1. MariaDB
      i. Galera Clusters


D. Perisian Web
1. HAProxy
* http://www.haproxy.org
2. Nginx + Varnish
* Nginx http://nginx.org
* Varnish https://www.varnish-cache.org


E. Perisian sokongan untuk Cluster
   1. Rsync
         * https://rsync.samba.org/ 
   2. FUSE SSH
   3. Ganglia


Disediakan oleh :-


Harisfazillah Jamel


http://blog.harisfazillah.info / [email protected] 


23 Ogos 2015 (V 1)


Google Doc share link






Cluster Dalam Dunia Open Source

WHO AM I - LinuxMalaysia I'm a technical guy by heart, an ICT security by hobby and a Project Manager by profession. I love Linux and Open Source Software. #linuxmy 



NO_PUBKEY During Installation Java 8 for Linux Ubuntu 14.04 LTS

I have problem to install Java * for my Linux Ubuntu 14.04 LTS. This is due to error NO_PUBKEY

I'm using WebUpD8 Ubuntu PPA (Oracle Java (JDK) 7/8/9

https://launchpad.net/~webupd8team/+archive/ubuntu/java

error from

apt-get install oracle-java8-installer

Reading package lists... Done
W: GPG error: http://ppa.launchpad.net trusty Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY C2518248EEA14886

I need to get this from web browser due to firewall is blocking the needed TCP port. The key can be copy and paste from here :-

http://keyserver.ubuntu.com:11371/pks/lookup?op=get&search=0xC2518248EEA14886

-----BEGIN PGP PUBLIC KEY BLOCK-----
Version: SKS 1.1.5
Comment: Hostname: keyserver.ubuntu.com

mI0ES9/P3AEEAPbI+9BwCbJucuC78iUeOPKl/HjAXGV49FGat0PcwfDd69MVp6zUtIMbLgkU
OxIlhiEkDmlYkwWVS8qy276hNg9YKZP37ut5+GPObuS6ZWLpwwNus5PhLvqeGawVJ/obu7d7
gM8mBWTgvk0ErnZDaqaU2OZtHataxbdeW8qH/9FJABEBAAG0DUxhdW5jaHBhZCBWTEOItgQT
AQIAIAUCS9/P3AIbAwYLCQgHAwIEFQIIAwQWAgMBAh4BAheAAAoJEMJRgkjuoUiG5wYEANCd
jhXXEpPUbP7cRGXL6cFvrUFKpHHopSC9NIQ9qxJVlUK2NjkzCCFhTxPSHU8LHapKKvie3e+l
kvWW5bbFN3IuQUKttsgBkQe2aNdGBC7dVRxKSAcx2fjqP/s32q1lRxdDRM6xlQlEA1j94ewG
9SDVwGbdGcJ43gLxBmuKvUJ4
=0Cp+
-----END PGP PUBLIC KEY BLOCK-----

From my terminal, I ran this command

sudo apt-key add -

 and pasted the output from the above command (the public key) into the stdin ans enter, followed by control-D.

Hadoop On Google Cloud Platform

I'm trying Google Cloud computing to install hadoop. Interesting because there is no need to think hard hadoop installation. I hope this post can help you in identifying the use hadoop in big data. Visit this link to learn Hadoop in Google Cloud Computing


Need to learn new things.

Google Cloud Platform Hadoop SSH terminal

I'm stuck with warning "insufficient permission". Found out I need to authorize Google Cloud SDK to my Google Account setup for Google Cloud Computing with Hadoop.

Issue this command

gcloud auth login

to the master vm of your Hadoop.

More info

https://cloud.google.com/compute/docs/gcutil/#auth

Malaysia Open Source Community & Contact Update Profile Form For Year 2015


This form is prepared by Harisfazillah Jamel aka LinuxMalaysia. This form is to update Malaysia Open Source communities detail and information. 

We need to create an up to date list of all Open Source Community in Malaysia.

Please help me by sharing this to your friends. This is an open form, you can add in your community event you are not the community leader. I will contact them for more information.


Malaysia Open Source Community & Contact  Update Profile Form For Year 2015


Harisfazillah Jamel @ LinuxMalaysia Open Source Open Source Evangelist



Ever since he found Linux in 1998, Harisfazillah Jamel have been advocate the usage of open source software and building active open souce communities in Malaysia. As a lobbyist and as an activist.

Open Source Software is about freedom of sharing and collaborating together as a community in establishing software solutions which suit the needs. The “gotong royong” creates number of software which now uses by variety of vendors ranging from small to medium-sized firms to large multinationals companies. It is in my believe, and the same believe shared by many others, that we should nurture world class developers. The world class developers that can produce international recognized open source software or developers that maintain well-known open source software.

Rather than be users, we shall be the producers and maintainers to number of open source software. We need to start and we shall start now. Community by their own initiatives create number of projects with the hope by using open source software, its will help us to produce the world class developers. Open Source communities have a big impact in human capital development in producing the world class developers in Malaysia.

Lets make this happen, for the future of our generations.

Kalau kita beri makan ikan, anak-anak kita hanya akan kenyang sehari. Bila kita ajar mereka memancing, mereka akan kenyang bertahun.

Harisfazillah Jamel @ LinuxMalaysia

21 Feb 2015



Popular Posts

Labels

64bit Activity Adempire advocate Akta Apache ASAS Azam backup backuppc Bash Beowulf Big Data Broadband Budget Centos Cinta Cluster CMS cmsfornerd Complain computer Computer Operation Conference Contest Data Centre Operation DBmail Digg Digital Certification Discussion Group Django DNS Domain Duit Online Economy email email server English Evangelist Events Family Tree Fedora File System Firefox Foss FOSS.my FreeBSD FTX Gluster Gmail Godaddy.com Google Google App GTUG Hacking Hadoop Harisfazillah Jamel horde HP-UX hwclock IBM Indonesia Internet Internet Tools Itanium Jaring Java Javascript Jepun Jiwang Joke Joomla Kesihatan KOSTEM ldap Linux Linux Counter linuxmalaysia Love Mailman MailScanner Mailwatch Malay Malaysia MAMPU MDeC meetup Melaka Melayu Merdeka Microsoft Migration mirror sites Money Online MOSC 2010 MOSC2010 mosc2011 MOSC2013 MOSCMY MOSCMY2014 MOSCMY2015 Mozilla MPI MSC Malaysia MSC Malaysia OSCONF MSCOSCONF My Love MyGOSSCON MyMeeting Mypenguin99 mysql Nagios NagiosQL Negaraku nss_ldap ntp OBW2014 Open Office Open Source openldap Openoffice.org OpenStack Opera OS2 OS400 OSCC OSCC MAMPU osdc.my OSS OSS Policy OWASP Parallel Computing People Power Personal PGP PHP Pligg Politik Postfix Postgresql Programming Proxmox Python q1moscmy2015 Questionnaires Research Research tools RPM SASSIAN Sassian 85-89 Sassians 85-89 SCO Security Sekolah Sekolah Alam Shah Shell script Software License Solaris SongketMail SongketMailFilter sourceforge spam spamassassin Spoof Survey SVR4 System Tools Technorati Terjemahan Terminal TMnet Training translation Treasury Malaysia Trend Micro Twitter Ubuntu Unix Virtualization VMS VOIP Wang Web Server Windows Zimbra