prior belief

Go back to the [[AI Glossary]]

What you believe about the data before you begin training on it. For example, L2 regularization relies on a prior belief that weights should be small and normally distributed around zero.