The Mitzvah to Believe and the Principles of Faith
The Rambam has 13 principles of faith that a person must believe in. Part of the definition of Orthodoxy is having belief in certain fundamentals of faith. These principles are necessary and are building blocks for most other hashkafa's and values in Torah.
- God exists, created and controls the Universe
- God is One
- God has no body or physical properties
- God is the First Being and preceded the Universe
- God is the only one to worship
- God knows the thoughts of men
- God communicates to prophets
- Moshe was the greatest of all prophets
- Torah is divine
- Torah will never change
- God rewards and punishes
- Mashiach will come
- The dead will be revived
Obligation to Believe
- There is a mitzvah to believe in Hashem.
- There is a mitzvah to believe that Hashem is one.
- One may not believe in any other God besides Hashem.
- There is a mitzvah to believe that there will be an ultimate redemption brought about by Mashiach.
Prohibition to Stray after other Beliefs
- There is a constant biblical prohibition to stray after thoughts that are against our belief.
Proving the Existence of God
Ramification of Disbelief
- A person who does not believe in any of the 13 principles of faith loses their share in Olam Haba. 
Causing others not to believe
- Some say that it is forbidden to be a librarian in a secular library because in doing so you'll have to give books which speak of heretical ideas to anyone who wants them, which is a violation of Lifnei Iver. 
- Pirush Mishnayot (Sanhedrin 10:1)
- Shemot 20:2, Rambam (Sefer HaMitzvot, Aseh n. 1), Sefer HaChinuch (n. 25), Smag (Aseh n. 1), Chaye Adam 1:5, Biur Halacha (1 s.v. Hu)
- Devarim 6:4, Rambam (Sefer HaMitzvot, Aseh n. 2), Sefer HaChinuch (n. 417), Smag (Aseh n. 2), Chaye Adam 1:5, Biur Halacha (1 s.v. Hu)
- Shemot 20:3, Rambam (Sefer HaMitzvot, Lavin n. 1), Sefer HaChinuch (n. 26), Smag (Lavin n. 1), Chaye Adam 1:5, Biur Halacha (1 s.v. Hu)
- Smak (Mitzvah n. 1)
- Brachot 12b derives from the pasuk Bamidbar 15:39 that there is a prohibition to stray after anti-Torah beliefs.
- Pirush Mishnayot (Sanhedrin 10:1), Rambam Teshuva 3:6-8
- Yalkut Yosef YD 157:7