Results tagged “Sedubai” from dubaiGeek

SEDUBAI MINDMAP.png

In today's troubled property market, making the right choice is the hardest thing.

Dubai has suffered from the market down turn too, but geopolitically and financially Dubai still has a major role in the Middle East. Studies show the massive population of expats cannot leave the city easily and hopefully gold rush age comes back again.

Making the right choice in finding a right property, this is the reason behind the idea to make something that didn't exist before.

Imagine there are thousands of Real Estate agencies working in Dubai, each has got its own website and property list. To make the right choice, you have to go through all of them one by one and search for your lifetime purchase.

It makes life difficult. Practically web is useless in the property market. The easy solution to this is to list your property in a listing such as Gulfnews classifieds or similar online listings.

By accepting the fact that your website is useless you are actually accepting that all the budget you spent on designing your own property listing has gone wasted.

There is another solution to this, which has been already discovered, a Search Engine. To this date, we have Image Search, Book Search and ... But not a Property Search Engine.

Why? The answer is more technical. Indexing a Property list is not as simple as indexing a normal webpage. It needs reverse engineering to get to the actual database.

In Sedubai, we do the difficult part. We index property lists in Dubai and combine all the available results to bring a single, complete and practical tool for Dubai Property Market.

Imagine having a Google just to search for properties. Sedubai can bring back the hope to Dubai property market. You can be rich again by having access to the data.

New milestone

|
Since the market is not so good, I thought of a new strategy. If the market recovers by 3Q of 2010, and if I rely on the data by then, when the market recovers the I will work more on the functionality.
What I have done. I got my supercomputer, so much missed him. Then I fixed the broken crawlers. Also added 2-3 new crawlers, by crawler I mean new property lists to crawl.

I've got so much hope that this is going to work, but as days go by, I find less time to work on it.

Shame on me, Do the job Ali :(

The Miracle: Information

|
So now I have a Search engine, fully functional, not perfect but exists as a piece of art and hard work. Now I have to convince myself that it wasn't a mistake. I must hope market will be in my favor again. I must hope ...

So now that the property market is going down and down, some see no way to survive. But I do believe there is always a path to recovery.
The only thing we can rely on is Knowledge and Information,in my opinion.

There is a fact that should not be forgotten, we humans multiply and need somewhere to live. We might watch less movies or not waste our money in a useless market, But we need a place to live.
Whether it's Dubai or London or Delhi or North pole, still we need a tiny place to live. So the property market is never going to be out dated.

People leave because they don't know what to do. No one can guarantee the destination is a better place. 
The economy can not take the sun, sand and beach away.
The business can easily survive because Dubai was and is still the business hub of the whole middle east population.
Dubai can survive, Why it is not doing so is lack of knowledge.

If people know how to live cheaper, Landlords know how to be more fair, Government knows how to divert the trouble and make something out of it, then there won't be any problem.

There is always a chance to make something out of nothing.
I make Information easily accessible by bringing them all together in one place and give it an extra touch.
Sponsor me, I won't disappoint you.

Huge updates for Sedubai

|
In the past days I've done so much for the search engine.
Currently there are 41 property list indexed by the crawler.
There has been a thousand minor fixes.
The spell checker works so so good now.
There is an empty result page now.
The interface is so so good now.
The price functions properly now.
You can see the latest crawler status now. What lists are indexed and the details.
There is a Help page, About page, ...
The dictionary is more complete now.

What kept me awake every night was the Search box analyzer. The way it finds type, location, and price. It was a nightmare how to deal with different search terms. But now it works, now it's beautiful.
I didn't simply fix the bugs and issues; I really put my brain on it to come up with the best method to develop a better AI.

It's enough for this weekend. Better take a break.

Usual Big steps

|
This weekend was amazing.
Actually not so amazing because I didn't leave the house at all. Just sat infront of the montior and looked at property lists.
But although it wasn't a happy weekend, I'm happy about it.
I could index 16-17 new websites now. It was only 4 and within 2 days it reached 17. That's a good sign,
This weekend it might reach 50 or so.
What worries me now is that the Mac Book Air can't crawl the whole list. My friend who was suppose to be back from Dubai by now is still there and my super computer is still in Dubai.
I need it more day by day :C

I'm still working on the design part of it. I think it looks better now but not sure yet. It's difficult to do everything with the smallest laptop in the world. But a geek can do so.

please go and visit my sedubai at www.sedubai.com

Also, I'm trying to get it listed on other search engines. my exprience shows that I have to make my site first on the google. same as www.Photodubai.com

That was a successful web exprience, I made the site in 2004 and now it's 5 years that the site is up and running, from a very small and simple website to a very sharp well cutted design and thousands of photos.

I make Sedubai a nobel site too. I make it.

Speeding up the development

|
Although I had a busy happy weekend, still I could manage to have a big step done.

I couldn't come up with a new style yet. The old one is so beautiful but honestly not the correct look and feel.

I think the location query is better now.
The web app recognizes Buy and Rent now.

ooh, It's now Keyword oriented as well. It's so helpful for the search result. Yoohoo.

And I could manage to have 3 more sites indexed.

The only problem is, my little Air Book doesn't survive crawling all the sites. So I'm waiting for my 64bit quad core super computer to come from Dubai.

I assembled it specially for Crawling Indexing website, because my server side application is also 64bit coded application.

What to come: More sites to Crawl

4 In the morning

|
London, 4 in the morning.

I've got the pattern analyser working again. I've tested betterhomes website and it could find the pattern of property list.

And I have found a new trick to list Ajax orianted listings. I used to love ajax but cracking deep into it is not as easy as I thought.

So I simply disable Java in my browser and wait to see what comes up. If there is a version for not ajax browsers then fine, if not then I just do list that real estate in my index.

Now, let's find more and more websites....
It's weekend tomorrow. I hope I get to somewhere good.

What am I going to do now?

|
Somehow everything is settled down here in London.
Still haven't got my super computer from Dubai and I just work on my two laptops.
Somehow I'm happy with my websites, except the Sedubai project which has great future but needs alot more work to be done.

I was just checking the crawler. out of 8 websites i used to crawl just 2 of them are working. the rest are either offline or changed the format of their websites.
I've got to get this up and running.

I have pretty amazing ideas for it.

MacBook Air on 21" Display

|
Honestly, It might be small in size but It's powerful inside, So when I actually use it on my 21" LCD, I feel I'm using a Mac Pro.

Alright, I have uploaded the Beta version of Sedubai,
This weekend I'm going to work on it's AI text recognition. and next weeks I will try to add more listing to it.

The important achievement is that It's working on Web and on Server. Yeah It's actually working, slow or fast, complete or incomplete, It's working ;D yoohoo

Sedubai Server Side

|
I'm wondered how much energy I'm putting in making sedubai.
Although I've working so hard every day to launch MBCPersia, but everyday I wake up at 6oclock and work an hour and half on it.

To my assumption, except adding more website to crawl, the server side of the project is completed.
  • It has got a schedule to crawl website every 3 hours.
  • It syncs the server index database with online database at the scheduled time.
  •  Each Website has got it's own crawler (class file, plugin) which works on its own threat and async
  • Visual GUI of the Server application is amazing, It gives the report of all activities which are going on right now
  • On Quad Core 2 64bit server, It is really fast,

I was testing the Web application yesterday, It still needs some bug fixing to be ready to run.
But...
The main part is
1. Adding more property listing to crawl
2. Feeding the actual knowledge for the AI to work.

So I've got analyse the search terms, project names, locations and calculation of different currency. Calculation of currency was in the design since beginning, you enter what ever budget you have in whatever currency and the application converts it and finds the best result with AED price converted.
Yep, The latest update on my own search engine is that I have made all the crawlers into multithreaded async mode. It's like they work all together and get the best of my internet bandwidth to download websites and crawl them.

It used to be like each crawler had to wait for the other crawler to finish. now with the new quadcore 2 64bit server which I got the crawling has become easy. It used to take an hour to crawl 6 listings and now I crawl 12 listings within 10 minutes.

good good, I'm going to run it on test phase on a very good hosting. still work on the front side is not completed!

Blogging about the Spider

|
Now that my project (my idea) is reaching somewhere, I decided to start blogging about it.
Honestly the actual project is 20 days ahead of this blog, and I'm trying to finalize a first version of it very soon