To build an actual blog from scratch, you'd need to use something like PHP, ASP, Ruby on Rails or Django.
These allow you to build dynamic content, which is to say that they allow you to build application scripts that run on your web server, making it possible to create sites which access databases and react based upon user actions.
The usual way of reversing blog entries is to store them in a database such as MySQL.
You'd then be able to query the database like this:
Code:
SELECT * FROM `blog` ORDER BY `id` DESC
In English: Get all the data in the "blog" table, working backwards from the highest I.D. to the lowest (assuming the database uses an automatically incrementing I.D. field, newer entries will have a higher I.D. number).
You'll also want to use a server side scripting language for comments as your blog will have to have a way of saving them to either a file or a database table.
PHP is the most common server side scripting language, but it may not be for you, so it's worth looking at a number of different options.
Personally, I use Ruby on Rails, which makes getting the essentials up and running easier than PHP, but which can require some experimentation or down right hackery to get some more complex stuff done (theme support can be annoying as some methods of adding theme support require that Rails' core code is overridden, which isn't good if it changes in the future).
It probably will take a fair while to get to the stage of having a fully functioning blog online if you've got little experience with site building, but it shouldn't be too difficult to learn the basics.
I'd recommend looking into learning:
PHP or Ruby on Rails (server side scripting)
MySQL (database)
CSS (styling language used with HTML or XHTML)
XHTML (I'm assuming you're already learning a form of HTML)
