This guide assumes you know nothing about TensorFlow and takes you from the beginning until understanding the basics of a TensorFlow program including Variables, Placeholders, dataflow graphs, TensorFlow Core API, and TensorBoard for visualization. Because artificial neural networks (ANNs) are in the heart of deep learning models, it is recommended to start learning how they work and implemented programmatically. This guide covers in details all steps required for creating your first ANN using TensorFlow starting by reading input data then building neural networks layers (input, hidden, output) and finally making predictions. This guide helps you how neural networks parameters (e.g. weights) are updated by tracing the dataflow graph. Because the traditional way of reading data using placeholders is not appropriate for large datasets, pandas Series and DataFrame are discussed by understanding the different ways they are created. This is in addition to indexing, updating, deleting items. In addition to TensorFlow Core API, some higher level APIs are discussed including TensorFlow Estimators and train for saving time wasted by implementing some of the frequently used operations.