The rectum is the last part of the large intestine attaching to the anus. An abscess is a collection of pus. A rectal abscess also called "perirectal" abscess can form around the edge of the anal opening or deeper into the rectum. This condition is more often found in men and in people with digestive diseases.