Canary API is coming!

Hi all,

Just a brief update here: Canary’s API is coming along nicely and will soon be looking for testers. If you’re interested, please reach out to me via Twitter (@afreak) or e-mail me at general@afreak.ca.

I won’t be able to respond immediately but I will put you down on a list to contact.

Massive update and presenting at BSides Vancouver 2014!

I’ve been silent as of late! This should not indicate anything however with Canary as I have been actively developing it and tuning it to be better and more feature-rich. How about we cover what has been changed?

You can view all the changes now at: https://canary.pw

New features

Who done what? Related results!

canary_febupdate_01

This is the feature I have been wanting to have up and running since day one: related items.

Basically if you view a document, it will attempt to find anything related to it based on its content. There are still some features to be added to that functionality, but it’s quite possible you could suffer from the same problem that some people have when reading one Wikipedia article and finding that you’ve gone from My Little Pony to Adolf Hitler in two hops (try this if you’re curious about this).

Expanded search

canary_febupdate_02

The search has been moved to the top-right of the screen like in the old version but has been simplified to allow for you to look for other items in the process. Gone are the mentions of the bangs (they’re still there however) but ready to read is a help page.

I have removed the functionality that allowed for searching of phone numbers. The reason for this is quite simple: the false positives were quite problematic.

The bangs are fully documented now and have had some of their abilities extended. You can check out the Help page to see more.

Presenting at BSides Vancouver

I will be presenting at BSides Vancouver on March 11th. The talk will feature some of the origins of Canary and will also discuss some other related items. I definitely invite you to come out if you’re able to come to the conference.

I plan to submit this elsewhere so stay tuned for that.

Donations

I am looking for donations as I wish to expand the service. There is a plan to expand this service to allow for access via an API, but this won’t be available for a few more months.

You can submit a donation via the links on this page:

https://canary.pw/donate/

I also take DOGE if you wish to send me that as well. :)

The address for DOGE is DU8hYS4Z9Nb3fG155LfcnxMVjKzp3MJJsN.

Bug reports

Please let me know via Twitter (@afreak) or via IRC (afreak on Freenode) if you wish to let me know of a problem. At the time of this writing, I am aware of the problem with the left column links when viewing the page, but I have a fix due for tomorrow.

Performance improvements

Small update here, but the performance of Canary has been drastically improved. Some changes were made to the database structure and data retrieval and it is now much, much faster. In addition, the hash searching is a lot more refined and will give far more accurate results.

There is a large feature coming to Canary in the next month or two so stay tuned!

New feature! Hash searching

Canary went through a bit of an upgrade to improve its back-end services and with that came a new feature: hash searching!

It works like this:

!hash 5f4dcc3b5aa765d61d8327deb882cf99
!hash password hacked

Both will give you results based on your request. You can use SHA or MD5 hashes or just generic keywords.

I was going to slip in a new feature but that will be included in a minor update in the coming weeks.

Also, I will be at VanCitySec’s special August event speaking about Canary (very brief mind you) and will be open to meet with anyone who wants to ask questions. :)

More data, a new feature, and VanCitySec

Alright! It has been a few weeks since I said anything about Canary and it is still alive almost a month later! I have gotten a lot of feedback and questions since first releasing the service almost a month ago. Really glad to see the responses I have gotten so far and do not hesitate to ask me anything should you have any questions.

Sometime this upcoming long-weekend (it’s one here in Canada), I will be releasing an update of Canary to the server which will include a new feature and more data. The latter I won’t get into too much but I anticipate about 25% more data per day as a result. Since the service went live, over 200,000 new entries have been added to the database.

The new feature is that you’ll be able to search for pastes that specifically have hashes (specifically MD5 and SHA). This will go live by Monday and will permit you to search for specific hashes or for text that would be in anything that contains hashes.

I may try and squeeze one more feature in before the update but that will be a surprise for now!

Also, if you’re in Vancouver and are interested in meeting me and would like to have some beer and pizza, come see me at VanCitySec this upcoming Wednesday, August 7th. This is a special edition as we’re usually on a Thursday and at the Railway Club on Seymour and Dunsmuir, but this month it’s being held at Vancouver Hack Space (VHS). If you’re interested, it’s free to come and while not obligatory, you can RSVP at this page as it allows for us to determine how much food and beer is needed.

I will be giving a brief presentation on Canary as well as presentations from two other people. However, it’s just a social gathering so show up and have a good time!

Announcing CanaryPW

Hello! If you’re reading this, then you’ve been made aware of the beta release of CanaryPW!

What is CanaryPW you might ask? Well, it is a search engine designed to look through text that has been publicly posted on services like Pastebin. A series of tools scan the text, pull out the interesting bits, and then are entered into a database. The interesting bits for now include e-mail addresses, phone numbers, IP addresses, and websites.

The idea behind this is to mirror the data posted on these sites so anyone can perform quick analysis. It also allows for individuals and organisations to determine if any proprietary information has been inadvertently made available and allow for mitigation.

Overview

This is the default CanaryPW screen. It’s a basic search with nothing super fancy in it.

And here are the results. Again, nothing fancy here either.

And then we get to the interesting stuff. Here’s the text and below is all of the data plus links to other texts that have been posted that have similar items. Basically you can search for something via CanaryPW and then have links to all results to see what’s up. Eventually you’ll be able to sort it by what has some interesting data and what is related to another entry.

This is an idea I borrowed from DuckDuckGo: ‘bangs’ have been incorporated into the search. It’s as simple as typing “!ip 127.0.0.1″ in the box and search for all texts containing that string. Other ‘bangs’ include !http, !host, !email, and !phone. More will be added as I start to further fine-tune the text analysis.

History

I’ve been playing around with an idea for a service for sometime and my friend, David had suggested to me that I build some sort of search engine for stuff posted on Pastebin, Pastie, and elsewhere. Sites like these have been used for all sorts of reasons including the posting of leaked credentials from services such as video game services, message boards, and news sites. The idea here is to allow quick and easy access to this information so to allow anyone affected to react quickly to mitigate the problem.

The project itself started in late March and a test version of the site was launched in early June. And here we are today with a formal launch of the service with much, much more to come.

Closing

I would like to thank those who have assisted so far with the project. I will be releasing more details as time progresses. There are some bugs that still need to be worked on namely in the database sorting side of things and rendering the site on Internet Explorer.

If you have any questions or comments, feel free to respond below or send an e-mail to support@canary.pw.

[edit]

One person said I didn’t link to the page! It’s on the right but it’s also available here:

https://canary.pw

Follow

Get every new post delivered to your Inbox.