Asterisk security involves properly configuring files like SIP.conf and dial plans to prevent extension hopping and restrict access. It is also important to limit the default context, monitor the system, and use secure protocols to protect privacy. Hardening the system through practices like restricting ports and disallowing everything by default improves security.