Internet tools, Web Server (apache) and DNS (bind) on Apple using Homebrew

Online Internet Test Tools

BREW, XCODE and BBEdit command line tools

See:

• https://getgrav.org/blog/macos-bigsur-apache-multiple-php-versions

Setup:

• /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install.sh)"

Some in newer MacOS missing libs:

• brew install openssl

Needed for Python:

• sudo install -d -o $(whoami) -g admin /usr/local/Frameworks

If brew directories are not in the path:

• echo 'export PATH=/usr/local/bin:/usr/local/sbin:$PATH' >> ~/.zshrc

Nowadays this automattically installs Apples command line tools. If not then:

• xcode-select --install

If needed to re-install command tools do this command first to remove previous tools:

• sudo rm -rf /Library/Developer/CommandLineTools

Install BBEdit from https://www.barebones.com/products/bbedit/index.html

• https://www.marvtherobot.com/multi-user-homebrew/

• sudo chgrp -R admin $(brew --prefix)
• sudo chmod -R g+rwX $(brew --prefix)

Maintenance:

• brew update
• brew upgrade
• brew cleanup
• brew services list
• sudo brew services restart --all

Debugging:

• brew doctor
• brew --version

• sudo chown -R "$USER":admin /usr/local
• sudo chown -R "$USER":admin /Library/Caches/Homebrew

You may get an error warning: homebrew-core is a shallow clone. Explanation: This restriction has been made on GitHub's request because updating shallow clones is an extremely expensive operation due to the tree layout and traffic of Homebrew/homebrew-core and Homebrew/homebrew-cask. We don't do this for you automatically to avoid repeatedly performing an expensive unshallow operation in CI systems (which should instead be fixed to not use shallow clones). Sorry for the inconvenience! Therefore, to `brew update`, first run:

• git -C /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core fetch --unshallow

To remove brew alltogether:

• sudo brew services stop --all
  
• /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/uninstall/master/install.sh)"

APACHE

Setup:

• brew install httpd
• sudo brew services start httpd

Maintenance:

To restart httpd:

• sudo brew services restart httpd
• sudo apachectl stop
• sudo apachectl -k restart

Debugging:

• tail -n 200 -f /usr/local/var/log/httpd/error_log
• tail -n 200 -f /usr/local/var/log/httpd/access_log

• sudo launchctl unload -w /System/Library/LaunchDaemons/org.apache.httpd.plist
• sudo apachectl stop
• sudo brew services restart httpd

To check what a site is running, if not installed install lynx first:

• brew install lynx
• lynx -dump -head <website> | grep ^Server

Check if deamon is running:

• ps -aef | grep httpd

• sudo apachectl -S

• sudo apachectl configtest

HTTPD config edits HTTP2, headers, userdirs, proxy

HTTPD config basic edits:

• bbedit /usr/local/etc/httpd/httpd.conf

1. Listen 8080 => Listen 80
2. enable ==> LoadModule deflate_module lib/httpd/modules/mod_deflate.so
3. enable ==> LoadModule rewrite_module lib/httpd/modules/mod_rewrite.so
4. ServerAdmin admin@example.net
5. #ServerName www.example.net:8080 ==> ServerName localhost:80
6. enable ==> Include /usr/local/etc/httpd/extra/httpd-autoindex.conf

HTTPD config edits to enable http2

• bbedit /usr/local/etc/httpd/httpd.conf

1. disable ===> #LoadModule mpm_prefork_module lib/httpd/modules/mod_mpm_prefork.so
2. enable ===> LoadModule mpm_event_module lib/httpd/modules/mod_mpm_event.so
3. enable ===> LoadModule http2_module lib/httpd/modules/mod_http2.so
4. add ===> Protocols h2 h2c http/1.1

Enable full filename display in case of directory index:

• bbedit /usr/local/etc/httpd/extra/httpd-autoindex.conf

add NameWidth=* to the line IndexOptions FancyIndexing HTMLTable VersionSort

1. ===> IndexOptions FancyIndexing HTMLTable VersionSort NameWidth=*

Enable example.net/~user.

• bbedit /usr/local/etc/httpd/httpd.conf

1. enable ==> LoadModule userdir_module lib/httpd/modules/mod_userdir.so
2. enable ==> Include /usr/local/etc/httpd/extra/httpd-userdir.conf

• bbedit /usr/local/etc/httpd/extra/httpd-userdir.conf

1. Change public_html into Sites (NOTE: 2 places!)
   

Optionally to enable (reverse) proxies.

• https://httpd.apache.org/docs/2.4/howto/reverse_proxy.html

In httpd.conf:

• bbedit /usr/local/etc/httpd/httpd.conf

1. enable ==> LoadModule proxy_module lib/httpd/modules/mod_proxy.so
2. enable ==> LoadModule proxy_http_module lib/httpd/modules/mod_proxy_http.so

• bbedit /usr/local/etc/httpd/extra/httpd-vhosts.conf

• Listen 12345
  <VirtualHost *:12345>
      ProxyPass "/" "http://127.0.0.1:12344/"
      ProxyPassReverse "/" "http://127.0.0.1:12344/"
  </VirtualHost>

Or for https:// in the ssl vhost file below to embed traffic in ssl:


Listen 12345
<VirtualHost *:12345>
    ProxyPass "/" "http://127.0.0.1:12346/" retry=1 acquire=3000 timeout=10 Keepalive=On
    ProxyPassReverse "/" "http://127.0.0.1:12346/"
    SSLEngine on
    SSLCertificateFile /etc/letsencrypt/live/example.net/fullchain.pem
    SSLCertificateKeyFile /etc/letsencrypt/live/example.net/privkey.pem
</VirtualHost>

HTTPD config edits for vhosts

HTTPD config edits enable vhosts:

• bbedit /usr/local/etc/httpd/httpd.conf

1. enable ==> LoadModule vhost_alias_module lib/httpd/modules/mod_vhost_alias.so
2. enable ==> Include /usr/local/etc/httpd/extra/httpd-vhosts.conf

• bbedit /usr/local/etc/httpd/extra/httpd-vhosts.conf

Let's Encrypt - certbot

• brew install certbot

• sudo certbot certonly --apache  --cert-name le-cert
  

• sudo certbot certonly --apache --cert-name le-cert --staging

• sudo certbot certonly --apache --cert-name le-cert --force-renewal

If pre, post or deploy scripts are needed, those go here:

• /private/etc/letsencrypt/renewal-hooks

• sudo certbot certonly --standalone --pre-hook "apachectl stop" --post-hook "apachectl start" --cert-name le-cert -d example.net -d sub1.example.net -d sub2.example.net -d example2.net ...

or if one first wants to do a number of test runs for debugging:

• sudo certbot certonly --standalone --pre-hook "apachectl stop" --post-hook "apachectl start" --cert-name le-cert -d example.net -d sub1.example.net -d sub2.example.net -d example2.net ... --staging

• sudo certbot certonly --standalone --pre-hook "apachectl stop" --post-hook "apachectl start" --cert-name le-cert -d example.net -d sub1.example.net -d sub2.example.net -d example2.net ... --force-renewal

If pre, post or deploy scripts are needed, those go here:

• /private/etc/letsencrypt/renewal-hooks

• sudo certbot renew

We have to make a launchd plist, see:

• https://gist.github.com/jgillman/8b29c5d75f9fbcf30d55f1a0de535c5d
• https://ericfromcanada.github.io/output/2019/automatic-renewal-lets-encrypt-macos-server.html

Create plist:

• sudo mv com.letsencrypt.renew.plist /Library/LaunchDaemons/com.letsencrypt.renew.plist
• sudo chmod 644 /Library/LaunchDaemons/com.letsencrypt.renew.plist
• sudo chown root:admin /Library/LaunchDaemons/com.letsencrypt.renew.plist
• sudo launchctl load -w /Library/LaunchDaemons/com.letsencrypt.renew.plist
• sudo launchctl list | grep -i letsencrypt

If test runs are needed:

• sudo certbot renew --dry-run

• sudo tail -f -n 400 /var/log/letsencrypt/letsencrypt.log

To list the certificates:

• sudo certbot certificates

Some more debugging:

• https://letsdebug.net/

The configuration file is at: /etc/letsencrypt/renewal/

• bbedit /usr/local/etc/httpd/httpd.conf

Uncomment:

• bbedit /usr/local/etc/httpd/extra/httpd-ssl.conf

1. Make sure these parameters have following values:
   • SSLCipherSuite          "ECDHE-ECDSA-AES256-GCM-SHA384 TLS_AES_256_GCM_SHA384 ECDHE-ECDSA-CHACHA20-POLY1305 TLS_CHACHA20_POLY1305_SHA256 ECDHE-ECDSA-AES128-GCM-SHA256 TLS_AES_128_GCM_SHA256 ECDHE-RSA-AES256-GCM-SHA384 ECDHE-RSA-CHACHA20-POLY1305 ECDHE-RSA-AES128-GCM-SHA256 ECDHE-ECDSA-AES256-SHA384 ECDHE-ECDSA-AES256-SHA ECDHE-ECDSA-AES128-SHA256 ECDHE-ECDSA-AES128-SHA ECDHE-RSA-AES256-SHA384 ECDHE-RSA-AES256-SHA ECDHE-RSA-AES128-SHA256 ECDHE-RSA-AES128-SHA "
   • SSLProxyCipherSuite     "ECDHE-ECDSA-AES256-GCM-SHA384 TLS_AES_256_GCM_SHA384 ECDHE-ECDSA-CHACHA20-POLY1305 TLS_CHACHA20_POLY1305_SHA256 ECDHE-ECDSA-AES128-GCM-SHA256 TLS_AES_128_GCM_SHA256 ECDHE-RSA-AES256-GCM-SHA384 ECDHE-RSA-CHACHA20-POLY1305 ECDHE-RSA-AES128-GCM-SHA256 ECDHE-ECDSA-AES256-SHA384 ECDHE-ECDSA-AES256-SHA ECDHE-ECDSA-AES128-SHA256 ECDHE-ECDSA-AES128-SHA ECDHE-RSA-AES256-SHA384 ECDHE-RSA-AES256-SHA ECDHE-RSA-AES128-SHA256 ECDHE-RSA-AES128-SHA"
   • SSLProtocol             -all +TLSv1.2 +TLSv1.3
   • SSLProxyProtocol        -all +TLSv1.2 +TLSv1.3
   • SSLHonorCipherOrder     on
   • SSLSessionTickets       off
   • SSLCompression          off
   • SSLOptions +StrictRequire
   • # Add vhost name to log entries:
   • LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-agent}i\"" vhost_combined
   • LogFormat "%v %h %l %u %t \"%r\" %>s %b" vhost_common
2. point the certs at the correct places
   
   • SSLCertificateFile /etc/letsencrypt/live/le-cert/fullchain.pem
   • SSLCertificateKeyFile /etc/letsencrypt/live/le-cert/privkey.pem
3. change listen 8443 ==> listen 443
4. replace everything in the virtual host block including #<VirtualHost _default_:8443> and #</VirtualHost> by:
   
   <VirtualHost _default_:443>
       DocumentRoot "/usr/local/var/www"
       SSLEngine on
   </VirtualHost>
   
   <VirtualHost *:443>
       DocumentRoot "/Users/example/Sites"
       ServerName example.net
       ServerAlias www.example.net
       SSLEngine on
   </VirtualHost>
   <Directory "/Users/example/Sites">
       Options Indexes FollowSymLinks
       AllowOverride All
       Require all granted
   </Directory>
   

• bbedit /usr/local/etc/httpd/extra/httpd-vhosts.conf

Headers for security hardening

• bbedit /usr/local/etc/httpd/httpd.conf

1. enable ==> LoadModule headers_module lib/httpd/modules/mod_headers.so
2. add at the end of the conf file:
   
   <IfModule headers_module>
     header set Strict-Transport-Security "max-age=31536000; preload"
     header set X-XSS-Protection "1; mode=block"
     header set X-Frame-Options "SAMEORIGIN"
     header set X-Content-Type-Options "nosniff"
     header set Referrer-Policy "same-origin"
     header set Content-Security-Policy "form-action 'self' https:; object-src 'self' https:; frame-ancestors 'self' https:; require-trusted-types-for 'script';"
   </IfModule>

Some experimental:
#  header set Strict-Transport-Security "max-age=15768000; includeSubDomains; preload"
#  header set Content-Security-Policy "script-src 'self' 'unsafe-inline' 'unsafe-eval'; object-src 'none';  frame-ancestors 'self'; require-trusted-types-for 'script';"

References:

• https://wiki.mozilla.org/Security/Server_Side_TLS
• https://bettercrypto.org/
• https://ssl-config.mozilla.org/
• https://internet.nl/

HTML default header

DNS - bind and rndc

Setup:

• brew install bind
• rndc-confgen -a

Edit the conf file:

• bbedit /usr/local/etc/named.conf

directory "/usr/local/var/named";
version "unknown";
rate-limit {
           responses-per-second 15;
           window 5;
           log-only no;
};

And create the zone files in:

• /usr/local/var/named/

• sudo brew services start bind

Maintenance:

• rndc sync -clean
• rndc reload
• sudo brew services restart bind
• sudo brew services stop bind

If the server for the domain gets a new ip address:

• on the master server in /usr/local/etc/named.conf
• change ip address if needed for primary or secondary server entries
  
• change ip address in reverse pointer record entry
• on the master server in /usr/local/var/named
• in all relevant zone files change the ip addresses
• also in those zone files increase the SOA serial numbers
• refresh the bind server with a bind restart or rndc reload
• at the dns registrar update the glue records
• at each of the secondary name servers in /usr/local/etc/named.conf
• change the appropriate ip addresses to the new values
• refresh the bind server with a bind restart or rndc reload
• request your ISP to update the reverse pointer for the ip addresses.
  

Debugging:

First set up a separate window with tail of logging:

• tail -f -n 40 /usr/local/var/log/named/named.log

Some checks:

• rndc status
• named-checkconf -z /usr/local/etc/named.conf
• host -t ns example.net

MX, SPF, DMARC and CAA

Zone file specials examples on MX, DMARC, SPF, CAA

MX

•  @              IN MX      10 smtp.example.net.

SPF

SPF (Sender Policy framework) record to indicate where email from this domain is approved to come from:

• @              IN TXT     "v=spf1 a mx -all"

• @              IN TXT     "v=spf1 -all"

DMARC

r=relaxed, s=strict

• _dmarc      IN TXT     "v=DMARC1; p=none; pct=100; aspf=r; adkim=r; rua=mailto:sysadmin@example.net"

Strict with spf and dkim:

• _dmarc      IN TXT     "v=DMARC1; p=quarantine; pct=100; aspf=s; adkim=s; rua=mailto:sysadmin@example.net"

CAA

• @              IN CAA     128 issue "letsencrypt.org"

DNSSEC

Setup:

• https://kb.isc.org/docs/aa-00626
• https://kb.isc.org/docs/aa-00711
• https://www.sidn.nl/en/dnssec/dnssec-signatures-in-bind-named
• https://support.cloudflare.com/hc/en-us/articles/360021111972-Troubleshooting-DNSSEC

• The master zone files: edit those to change records, etc.
  • /usr/local/var/named/example.net.zone
• The keys:
  • /usr/local/var/named/keys/
• Bind can automatically sign and will produce intermediate files in the same directory as the zone files.

• mkdir /usr/local/var/named/keys

Then we need to once generate the keys for each zone file on the master DNS server. That can be done with the following commands:

• dnssec-keygen -3 -a ECDSAP256SHA256 -K /usr/local/var/named/keys/ example.net
• dnssec-keygen -3 -a ECDSAP256SHA256 -f KSK -K /usr/local/var/named/keys/ example.net

Enable DNSSEC in named.conf by adding the following configuration directives inside options{ }:

• bbedit  /usr/local/etc/named.conf

• sudo brew services restart bind

Now we need the Delegation Signing records to supply to the parent zone manager. Easiest is using dig and dnssec-dsfromkey:

• dig @127.0.0.1 dnskey example.net | dnssec-dsfromkey -2 -f - example.net

Debugging:

• dig DNSKEY example.net @localhost +multiline

• dig A example.net @localhost +noadditional +dnssec +multiline

• dig +trace +noadditional DS example.net @8.8.8.8 | grep DS

• http://dnssec-debugger.verisignlabs.com
• http://dnsviz.net/

DANE

Setup:

Work in progress. Let's Encrypt makes that it needs to be renewed every 3 months, or needs an adapted server certificate. Based on:

1. https://blog.apnic.net/2017/01/06/lets-encrypt-dane/
2. https://www.internetsociety.org/blog/2016/01/lets-encrypt-certificates-for-mail-servers-and-dane-part-1-of-2/
3. https://blog.apnic.net/2017/01/06/lets-encrypt-dane/
4. Van Kruyt: https://kruyt.org/postfix-and-tls-encryption/
5. https://joscor.com/blog/dane-tlsa-tutorial/
6. https://www.huque.com/bin/gen_tlsa

• https://crt.sh/?q=example.net
• study the current and recent issuer names, CN=<name>.

The current intermediate certificates from LetsEncrypt (see: https://letsencrypt.org/certs/) are:

Active:

• https://letsencrypt.org/certs/lets-encrypt-r3.pem
• https://letsencrypt.org/certs/lets-encrypt-r3-cross-signed.pem

Upcoming:

• https://letsencrypt.org/certs/lets-encrypt-e1.pem

Backup:

• https://letsencrypt.org/certs/lets-encrypt-r4.pem
• https://letsencrypt.org/certs/lets-encrypt-r4-cross-signed.pem
• https://letsencrypt.org/certs/lets-encrypt-e2.pem
  

• wget -q -O - https://letsencrypt.org/certs/lets-encrypt-r3.pem | openssl x509 -outform DER | openssl dgst -sha256 -hex | awk '{print "le-ca IN TLSA 2 0 1", $NF}'
• wget -q -O - https://letsencrypt.org/certs/lets-encrypt-r3-cross-signed.pem | openssl x509 -outform DER | openssl dgst -sha256 -hex | awk '{print "le-ca IN TLSA 2 0 1", $NF}'
• wget -q -O - https://letsencrypt.org/certs/lets-encrypt-e1.pem | openssl x509 -outform DER | openssl dgst -sha256 -hex | awk '{print "le-ca IN TLSA 2 0 1", $NF}'

• le-ca IN TLSA 2 0 1 67add1166b020ae61b8f5fc96813c04c2aa589960796865572a3c7e737613dfd
• le-ca IN TLSA 2 0 1 730c1bdcd85f57ce5dc0bba733e5f1ba5a925b2a771d640a26f7a454224dad3b
• le-ca IN TLSA 2 0 1 46494e30379059df18be52124305e606fc59070e5b21076ce113954b60517cda
  

• rndc reload
• rndc reconfig

DKIM

Setup:

Some thoughts about key management and key rotation:

If one goes for one key pair for several domains, one primary domain and several additional domains, all handled by the same mail server:

Assume a scheme of aliases to the prime domain. Do a number of aliases in each additional domain looking like:

$ORIGIN    additional.top.
...
key1._domainkey    IN CNAME key1._domainkey.prime.top.
key2._domainkey    IN CNAME key2._domainkey.prime.top.
key3._domainkey    IN CNAME key3._domainkey.prime.top.
key4._domainkey    IN CNAME key4._domainkey.prime.top.

In the prime domain each of them can point to either a retired or previous or current or a potential next key and rotate through those. so:

$ORIGIN    prime.top.
...
key1._domainkey IN TXT     "v=DKIM1;k=rsa;p="
key2._domainkey IN TXT     "v=DKIM1;k=rsa;p=MIIBIjANB etc etc etc"
key3._domainkey IN TXT     "v=DKIM1;k=rsa;p=HnYukyhgl etc etc etc"
; key4._domainkey IN TXT ==> to be used next time

Assume 4 key entries like this is enough (one previous retired, one old, one current and one to use next).
The to use next is commented out at the prime domain, so that when it gets used it is filled with key, uncommented  and can populate dns without cache issues. The scheme should be enough but can be expanded, and the scheme can still support individual keys per domain later with more editing.

• https://www.m3aawg.org/sites/default/files/m3aawg-dkim-key-rotation-bp-2019-03.pdf

Debugging:

• dig

MTA-STS

Postfix and Dovecot

Here some options to get a higher internet.nl score:

• Van Kruyt: https://kruyt.org/postfix-and-tls-encryption/
• https://tribut.de/blog/secure-your-services-using-sane-cipher-ordering

SSH on a different port number

• https://superuser.com/questions/1398824/cant-change-port-listen-on-macos-x-mojave-for-built-in-ssh
• http://www.iana.org/assignments/port-numbers

See also:

• https://hackertarget.com/ssh-examples-tunnels/

• ssh 22/udp # SSH Remote Login Protocol
• ssh 22/tcp # SSH Remote Login Protocol

• #   Port 22

using the commands for server side:

• sudo sed -i -e 's+ 22/udp+ 12345/udp+g ; s+ 22/tcp+ 12345/tcp+g' /etc/services
  
• sudo launchctl unload -w /System/Library/LaunchDaemons/ssh.plist
• sudo launchctl load -w /System/Library/LaunchDaemons/ssh.plist

and on client side:

• sudo sed -i -e 's+#   Port 22+Port 10422+g' /etc/ssh/ssh_config

SSH tunnel for e.g. VNC. Here we assume ssh over port 12345. After this tunnel setup one can use vnc to 127.0.0.1:5901 to reach the other machine:

• ssh -p 12345 -v -L 5901:127.0.0.1:5900 destination
• vnc://127.0.0.1:5901/

SSH tunnel for SMB for timemachine

Setup

• sudo ifconfig lo0 alias 127.0.0.2/32

• ssh-keygen
• ssh -p <port> remoteuser@example.net
• ssh-copy-id -p <port> remoteuser@example.net

• ssh -p <port> remoteuser@example.net
• sudo ssh -p <port> -i /Users/localuser/.ssh/id_rsa user@example.net

• sudo ssh -f -C -N -p <port> -i /Users/localuser/.ssh/id_rsa -L 127.0.0.2:445:127.0.0.1:445 -o ServerAliveCountMax=3 -o ServerAliveInterval=15 -o ExitOnForwardFailure=yes remoteuser@example.net

• brew install ssh
• brew install autossh

Start the tunnel:

• sudo autossh -M 0 -f -C -N -p <port> -i /Users/localuser/.ssh/id_rsa -L 127.0.0.2:445:127.0.0.1:445 -o ServerAliveCountMax=3 -o ServerAliveInterval=15 -o ExitOnForwardFailure=yes remoteuser@example.net

• chmod +x /usr/local/var/startup.sh
• sudo chmod 644 /usr/local/var/localhost.startup.plist
• sudo mv /usr/local/var/localhost.startup.plist /Library/LaunchDaemons/localhost.startup.plist
• sudo chown root:admin /Library/LaunchDaemons/localhost.startup.plist
• sudo launchctl load -w /Library/LaunchDaemons/localhost.startup.plist
• sudo launchctl list | grep -i startup
• ifconfig | grep 127
• ps aux | grep ssh

Maintenance:

• sudo ifconfig lo0 alias 127.0.0.2/32
• sudo ssh -f -C -N -p <port> -i /Users/localuser/.ssh/id_rsa -L 127.0.0.2:445:127.0.0.1:445 -o ServerAliveCountMax=3 -o ServerAliveInterval=15 -o ExitOnForwardFailure=yes remoteuser@example.net

Debugging:

• ifconfig | grep 127

• ps aux | grep tunnel

TimeMachine

Setup:

• https://www.macworld.com/article/2033804/control-time-machine-from-the-command-line.html

• man tmutil

• sudo tmutil enable
• sudo tmutil disable

To get the status of anything going on or progressing:

• tmutil status

• tmutil startbackup

• tmutil stopbackup

• sudo tmutil disablelocal
• sudo tmutil enablelocal

• sudo tmutil addexclusion <path of folder/file to exclude>

• tmutil destinationinfo

• tmutil removedestination ......

• tmutil setdestination volume_name

• tmutil listbackups

Debugging:

• http://www.garth.org/archives/2011,08,27,169,fix-time-machine-sparsebundle-nas-based-backup-errors.html

• sudo chflags -R nouchg   <the backup bundle>
• sudo hdiutil attach -nomount -noverify -noautofsck <the backup bundle>

If you have apfs:

• sudo fsck_apfs -y  /dev/diskXs2
  

if you have hfs:

• sudo fsck_hfs -drfy -c 2g /dev/diskXs2

• sudo fsck_hfs -p /dev/diskXs2
  
• sudo fsck_hfs -drfy -c 2g /dev/diskXs2

To scan for bad blocks:

• sudo fsck_hfs -S /dev/diskXs2

• sudo hdiutil detach /dev/diskXs2

• bbedit <the backup bundle>/com.apple.TimeMachine.MachineID.plist

• sudo tail -f /var/log/fsck_hfs.log
• log show --predicate 'subsystem == "com.apple.TimeMachine"' --info | grep 'upd: (' | cut -c 1-19,140-999

How to solve calendar problems

How to solve the error: "Apple Calendar Can’t Save Event to Exchange":

See: https://michaelkummer.com/tech/apple/macos-calendar-exchange/

• Quit Calendar application (Command + Q)
• Quit Apple Mail
• Open Activity Monitor (through Spotlight or Launchpad)
• Search for "Calendar" and quit all the relevant processes
• Open Finder and navigate to ~/Library/Calendars
• Double-check Activity Monitor to make sure no Calendar-related processes are running
• Delete cache files
• Relaunch Calendar

Network Performance tools

• https://fasterdata.es.net/performance-testing/network-troubleshooting-tools/

• iperf -s -i 4 -w 3M

• iperf -i 4 -t 1000 -N -w 3M -l 1M -c [servername]

• iperf3 -s -i 5

• iperf3 -i 4 -t 1000 -N -w 3M -l 1M -c [servername]

• nuttcp -S

• nuttcp [servername]

Smart Home - Homebridge

Setup:

• https://github.com/homebridge/homebridge/wiki/Install-Homebridge-on-macOS

• brew install node.js

• node -v
• npm -v

• sudo npm install -g --unsafe-perm homebridge homebridge-config-ui-x

• npm audit fix
• npm i --package-lock-only
• sudo hb-service install

• sudo launchctl unload -w /Library/LaunchDaemons/com.homebridge.server.plist
• sudo launchctl load -w /Library/LaunchDaemons/com.homebridge.server.plist

• npm uninstall -g homebridge

Debugging:

• sudo hb-service stop
• sudo launchctl unload -w /Library/LaunchDaemons/com.homebridge.server.plist
• sudo launchctl load -w /Library/LaunchDaemons/com.homebridge.server.plist
• sudo hb-service start

Oter usefull commands:

• Restart Command         sudo hb-service restart
• Stop Command             sudo hb-service stop
• Start Command             sudo hb-service start
• View Logs Command    hb-service logs

Common pitfalls, problems, useful commands

• After a brew upgrade some services may not work. One difficult to diagnose problem may be the firewall settings in MacOSX. It blocks by default incoming connections on unsigned bin's and executables need to be added in the list in the System Preferences Firewall settings. Also note that just putting there the /usr/local/bin/executable will not work since brew puts aliasses (links) there. Follow the link to the real bin. Same for /usr/local/sbin .
• After a "brew upgrade" the output may display an error that an old directory could not be removed and a sudo command is displayed. In reality the "brew upgrade" did not complete, so execute that sudo command and repeat "brew upgrade" and displayed error - sudo commands until nothing is being done anymore by that command.
• Somehow launchd has a different or incomplete PATH environment. Caused certbot renew to initially fail.
• If the mac is using lots of processes to index for SpotLight, to turn indexing off:
• sudo mdutil -a -i off
• and on:
  
• sudo mdutil -a -i on
  
• If you use screensharing and end the session, the target screen typically goes dark and locks. If you want the screen to stay on, then <see https://discussions.apple.com/thread/7345064>:
• sudo defaults write /Library/Preferences/com.apple.RemoteManagement RestoreMachineState -bool NO
• A mac that is protected with filevault may not reboot gracefully because a password is needed to access the startup disc. A way to do a reboot is:
• sudo fdesetup authrestart
• if you need to log out another user:
  • ps awwwwux | grep loginwindow
  • kill the pid of that user with:
  • sudo kill -9 [pid]
• Support files can be found HERE.
• SSH plus Screensharing
  • ssh -p 22 -N -L 5999:localhost:5900 user@example.net
  • vnc://localhost:5999
• Starting/stopping remote desktop. The commands in this article https://support.apple.com/en-us/HT201710  work with Apple Remote Desktop 3.2 and later. Here are commands that you can use:
  • Restart the ARD Agent and helper:
    • sudo /System/Library/CoreServices/RemoteManagement/ARDAgent.app/Contents/Resources/kickstart -restart -agent
  • Turn on Remote Desktop Sharing, allow access for all users, and enable the menu extra:
    • sudo /System/Library/CoreServices/RemoteManagement/ARDAgent.app/Contents/Resources/kickstart -activate -configure -allowAccessFor -allUsers -privs -all -clientopts -setmenuextra -menuextra yes
  • Turn on Remote Desktop Sharing, allow access for specified users:
    • sudo /System/Library/CoreServices/RemoteManagement/ARDAgent.app/Contents/Resources/kickstart -activate -configure -allowAccessFor -specifiedUsers
  • You must use the -configure, -access, and -privs options in a separate command to specify the set of users and their access privileges. For example, this command is for users with the short names "teacher" and "student." It gives them access to observe (but not control) the computer, and to send text messages:
    • sudo /System/Library/CoreServices/RemoteManagement/ARDAgent.app/Contents/Resources/kickstart -configure -users teacher,student -access -on -privs -ControlObserve -ObserveOnly -TextMessages
  • Unlike other kickstart options, you can’t combine the allowAccessFor options with other kickstart options. You must use it as in the last two samples above. You might have to call kickstart more than once to finish a computer’s setup. Remove access privileges for specified users ("student" in this example):
    • sudo /System/Library/CoreServices/RemoteManagement/ARDAgent.app/Contents/Resources/kickstart -configure -users student -access -off
  • Disable ARD Agent and remove access privileges for all users:
    • sudo /System/Library/CoreServices/RemoteManagement/ARDAgent.app/Contents/Resources/kickstart -deactivate -configure -access -off
• Shell need to change from bash to zsh now:
  • The default interactive shell is now zsh. To update your account to use zsh, please run `chsh -s /bin/zsh`. For more details, please visit https://support.apple.com/kb/HT208050.
    • cp .bash_profile .zshrc
    • chsh -s /bin/zsh
  • restart terminal
    • brew doctor
• How to get into a home router management interface:
• TP-Link
• http://tplinkwifi.net
  
• NetGear
• http://routerlogin.net
  

MacMini Setup (for SC/webcam/demo)

• Users & Groups
  • SNE-Admin
    • sne-admin
  • SNE-demo
    • sne-demo
  • Login Options
    • auto login sne-demo
• Power settings
  • never sleep computer
  • restart after power fail
  • prevent display sleep
  • awake with net access
  • start up 8h00 in the morning
• Desktop & Screen Saver
  • no screen saver
• Sharing
  • Screen Sharing
  • File Sharing
  • Remote login
• Security
  • turn off screen lock
  • enable location services
  • no filevault
• Date & Time
  • automatic time adjustment
• Display Menu.app
  
  • Download Display Menu.app.zip
• MenuMeters
• BBEdi
• Deskpicture SNE logo
  • SNE-desktop.jpg
  • http://delaat.net/logos/logo-sne/logo-sne-big-inv-flat.png
  • http://delaat.net/logos/
• Team Viewer Setup
• To keep mac from sleeping unexpectedlythat stops video
  
  • in terminal: caffeinate -di &
• EvoCam Setup
  • Evocam4 download
  • Evocam5 download
    • serial ES56-MUDX-9LD6-BRAG
    • Note:
      • EvoCam 4 crashes now and then but does recording fine, however is 32 bit app!
      • EvoCam 5 is more stable but gives unusable recordings, is 64 bit!
      • NOTE: the low resolution serve must start first, then the high resolution, otherwise video is low quality.
  • Settings
  • • Preferences
      • web server port nr 10456
      • Log Web Server access
      • auto-open docs from previous session at startup
      • make sure the low res is loaded first.
      • Finder Cam1.settings on desktop put in dock and set Open at login
      Cam1.evocamsettings
      • 320 * 180
      • 384 * 216
      • 480 * 270
      • font size 12
      • framerate 15
      • quality normal normal
      • fontsize 9
    • Cam2.evocamsettings
      • 1280 * 720
      • framerate 15
      • quality normal normal
    • Other resolutions 16*9
    • 256 * 144 -> YouTube 144p
    • 320 * 180
    • 480 * 270
    • 640 * 360 -> nHD
    • 768 * 432
    • 800 * 450
    • 848 * 480
    • 896 * 504
    • 960 * 540 -> qHD
    • 1024 * 576
    • 1152 * 648
    • 1280 * 720 -> HD
    • 1366 * 768 -> WXGA
    • 1600 * 900 -> HD+
    • 1920 * 1080 -> Full HD
    • 2000 * 1125
    • 2048 * 1152
    • 2304 * 1296
    • 2560 * 1440 -> QHD
    • 2880 * 1620
    • 3200 * 1800 -> QHD+
    • 3520 * 1980
    • 3840 * 2160 -> 4K UHD
    • 4096 * 2304 -> Full 4K UHD
    • 4480 * 2520
    • 5120 * 2880 -> 5K UHD
    • 5760 * 3240
    • 6400 * 3600
    • 7040 * 3960
    • 7680 * 4320 -> 8K UHD
    • 15360 * 8640 -> 16K

Online references

In this table are the commands for apache, bind and certbot via brew as in https://getgrav.org/blog/macos-mojave-apache-multiple-php-versions.

• Via homebrew
  1. https://getgrav.org/blog/macos-mojave-apache-multiple-php-versions
  2. https://getgrav.org/blog/macos-mojave-apache-mysql-vhost-apc
  3. https://getgrav.org/blog/macos-mojave-apache-ssl
  4. https://certbot.eff.org/lets-encrypt/osx-apache
• Using only installed version (not advised)
  
  • https://coolestguidesontheplanet.com/install-apache-mysql-php-on-macos-mojave-10-14/
• Via server (depricated, not advised)
  • https://www.macstrategy.com/article.php?210
• For email I use MailServe from Cutedge Systems.

New info & scratch space

How this page is made

• author Cees de Laat
• bluegriffon