You need to read the Bible. I realize you have said you are a new Christian. That is the best time to start! I started reading the Bible the day I was saved. You might want to read the 4 gospels, Matthew, Mark, Luke and John. Read the Psalms and you will learn so much about worshipping God, in good times and bad.
Then, you might want to start reading through the Bible. Read 3 chapters of the Old Testament, and 1 chapter of the New Testament daily and you will read through the entire Bible in a year. Find a newer version, which is easy to read, like NIV, or HCSB. Stick with it even if you don't understand. God gradually has answered all my questions.
as for worshipping God, there is no other joy quite like it!
"But the hour is coming, and is now here, when the true worshipers will worship the Father in spirit and truth, for the Father is seeking such people to worship him." John 4:23
"And above all these put on love, which binds everything together in perfect harmony. And let the peace of Christ rule in your hearts, to which indeed you were called in one body. And be thankful. Let the word of Christ dwell in you richly, teaching and admonishing one another in all wisdom, singing psalms and hymns and spiritual songs, with thankfulness in your hearts to God. And whatever you do, in word or deed, do everything in the name of the Lord Jesus, giving thanks to God the Father through him." Colossians 3:14-17
"Ascribe to the Lord the glory due his name; worship the Lord in the splendor of holiness.." Psalm 29:2
"Oh come, let us sing to the Lord; let us make a joyful noise to the rock of our salvation! Let us come into his presence with thanksgiving; let us make a joyful noise to him with songs of praise! For the Lord is a great God, and a great King above all gods. In his hand are the depths of the earth; the heights of the mountains are his also. The sea is his, for he made it, and his hands formed the dry land. ..." Psalm 95:1-6
So many more verses I could put up. We worship God for who he is! He is love. He is just, wise, & compassionate. He is the Creator. He is worthy of our praise. While Jesus came to earth as a man, to take our punishment for sin on the cross, you have to understand God is truth, all knowing, all powerful and is everywhere. God is not a person, subject to our rules, but is is the King of kings and Lord of Lords. Don't judge him using our standards. In fact, don't judge God at all! He is holy and perfect. Try praising him, it will change your life.
"Worthy are you, our Lord and God, to receive glory and honor and power, for you created all things, and by your will they existed and were created.” Revelation 4:11
"Let everything that has breath praise the Lord! Praise the Lord!" Psalm 150:6