SystemAdministration: Difference between revisions

From SoylentNews
Jump to navigation Jump to search
(removed obsolete information)
 
(14 intermediate revisions by 3 users not shown)
Line 16: Line 16:
| style="width: 40%; background-color: #f2f2f2;"|
| style="width: 40%; background-color: #f2f2f2;"|
'''timezone'''
'''timezone'''
|-
| xlefay
| Co-team leader
| UTC+2 (CEST)
|-
|-
| [[User:paulej72|paulej72]]
| [[User:paulej72|paulej72]]
| Co-team leader
| Co-leader
| UTC-4 (EDT)
| UTC-4 (EDT)
|-
|-
Line 32: Line 28:
| Member
| Member
| UTC-9 (AKDT)
| UTC-9 (AKDT)
|-
| robind
| Member
| ?
|-
|-
| Audioguy
| Audioguy
| Member
| Member
| UTC-7 (PST/PDT)
| UTC-7 (PST/PDT)
|-
| The Mighty Buzzard
| Emergency Reserve Member
| UTC-5 (CST/CDT)
|-
| martyb/bytram
| Catastrophe Reserve Member
| UTC-4 (EST/EDT)
|}
|}
<section end=whoarewe />
<section end=whoarewe />
Line 48: Line 48:


List of servers on linode: [http://wiki.soylentnews.org/wiki/Category:SystemAdministration/Servers  Category:SystemAdministration/Servers]
List of servers on linode: [http://wiki.soylentnews.org/wiki/Category:SystemAdministration/Servers  Category:SystemAdministration/Servers]
* [[soylent-www]] - Primary Apache and slash servers for main site.
* [[soylent-www]] - Primary Apache, mysqld, and varnish servers for main site. Fluorine hosts slashd and ipnd as well.
:: [[Hydrogen]], [[Fluorine]], [[Boron]]
:: [[Hydrogen]], [[Fluorine]]
* soylent-db -- mysql servers, holds the slash database.
* soylent-db -- ndb-cluster servers for mysql, hold the rehash database.
:: [[Helium]], [[Neon]]
:: [[Helium]], [[Neon]]
* dev -- Development server.
* dev -- Development server.
:: [[Lithium]]
:: [[Lithium]]
* staff-slash -- Staff only Slash server.
* staff-slash -- Staff server, ssh entry point, staff-only rehash.
:: [[Nitrogen]]
:: [[Boron]]
* irc -- IRC server and related services.
* irc -- IRC server and related services.
:: [[Carbon]]
:: [[Beryllium]]
* [[SystemAdministration/Backups|backups]] -- Backup services.
* [[SystemAdministration/Backups|backups]] -- Backup services. (NOT on linode)
:: [[Oxygen]]
:: [[Oxygen]]
* directory services  -- LDAP and Kerberos.
* directory services  -- Hesoid and Kerberos.
:: [[Helium]], [[Boron]]
:: [[Helium]], [[Boron]]
* [[soylent-services]] - mail, wiki, other services as needed.
* [[soylent-services]] - mail, wiki, other services as needed.
:: [[Beryllium]]
:: [[Beryllium]]
 
* [[load-balancer]]
==Known Problems==
:: [[Sodium]], [[Magnesium]]
 
* '''Need cron job to backup server'''
* No init script for Apache.
* Broken https configuration
** Mostly fixed, Slash is the problem child now
* Gluster is occassionally misfiring, manifests as Apache or slashd crashing depending on the node, can be fixed with the following command cocktail
<pre>
sudo umount -l /srv/soylentnews.org # tells linux to lazy unmount, required when glusterd took a dive
sudo service glusterfs-server restart
sudo mount -a # will remount gluster without an issue
 
Then restart Apache/Slashd as required
</pre>
 
==Stuff That Needs To Be Addressed==
* Hydrogen is off line due to performance problems
* Gluster is unstable on Fluorine and Boron and sometimes Hydrogen
* icinga/monitoring project needs to be picked up and completed
* Should have some sort of SN password safe
* Privilege Duplication - making sure that all services have multiple admins
* DNS, Audioguy is investigating some goofiness
* Systems Documentation needs to revised and brought up to date.
* Work Coordination, not always good communication when fundamental things change.
 
==Work Notes==
DNS is completely run and managed by Linode's DNS Manager service.  This was an expedient decision when trying to get off bluehost.  We may want to investigate putting the master zone file on helium or boron and having external services handle serving out our dns.


==Resources==
==Resources==

Latest revision as of 22:52, 27 September 2016

TeamPages - parent, Development

Welcome

This is a comphensive index dealing with aspects of system administration and management of our clusters, as well as some of the more archine bits of setup required to make it work.

Who we are

Sysop Team Main Page

nick

position

timezone

paulej72 Co-leader UTC-4 (EDT)
mechanicjay Co-leader UTC-4 (EST/EDT)
NCommander Member UTC-9 (AKDT)
Audioguy Member UTC-7 (PST/PDT)
The Mighty Buzzard Emergency Reserve Member UTC-5 (CST/CDT)
martyb/bytram Catastrophe Reserve Member UTC-4 (EST/EDT)


Index of Development Pages and Resources

Servers

List of servers on linode: Category:SystemAdministration/Servers

  • soylent-www - Primary Apache, mysqld, and varnish servers for main site. Fluorine hosts slashd and ipnd as well.
Hydrogen, Fluorine
  • soylent-db -- ndb-cluster servers for mysql, hold the rehash database.
Helium, Neon
  • dev -- Development server.
Lithium
  • staff-slash -- Staff server, ssh entry point, staff-only rehash.
Boron
  • irc -- IRC server and related services.
Beryllium
  • backups -- Backup services. (NOT on linode)
Oxygen
  • directory services -- Hesoid and Kerberos.
Helium, Boron
Beryllium
Sodium, Magnesium

Resources