In this paper, we relate certain finite-dimensional operator algebras to graphs and define their equivalent properties. Using these graph's properties, we will determine which algebras are semi-Dirichlet and how many non-unitarily similar semi-Dirichlet algebras there are corresponding to graphs with up to five vertices.