![]() ![]() The interface consists of two regions: the fixed position recessed left panel which holds the page title, a search bar, controls and the page outline. The interface was redesigned with CSS media queries to dynamically transition between different modes in response to different viewing environments. It also now uses WebGL Typed Arrays to further speed things up, such as sending data to and from the WebWorker thread. This makes page loads significantly speedier and allows greater compression ratios, for individual blocks can be made larger ( 256KB instead of 100KB). On the application end, the application has switched from a GWT-compiled LZMA SDK to a speedy, pure javascript decoder. This enables greater compression and less accidentally omitted content. The algorithm which strips extraneous content has been made far more sophisticated than the original series of regular expressions. The advantage is that at 1GB, it’s relatively easy to fit into any system. While ostensibly, the mere top 300k articles is far too narrow to delve deep into the long tail, the breadth of the meager 1/25th of articles consistently surprises me in its depth. Two dumps are distributed at time of writing, the top 1000 articles and the top 300,000 requiring approximately 10MB and 1GB, respectively. First of all, it compresses not the entireity, but rather the most popular subset of the English Wikipedia. The preprocessing toolchain was entirely rewritten for a multitude of reasons. The differences start even before the data gets to the application. Wikipedia never ceases to amaze me and, while I’ve tried in the past to encapsulate part of its sheer awesomeness, this marks a much more significant attempt. While near-ubiquitous connectivity alleviates this to a certain extent, the momentary lapses of networking are incredibly corrosive to an information dependent mentality. There’s just something incredibly alluring about the concept of holding the sum of human knowledge with you at all times. If you want to contact me or read obnoxiously nostalgic autobiographical trivia, check out the about section. ![]() This is my little corner of the internet, where I talk about random projects and ideas and stuff. I’m Kevin Kwok, and I’m currently a junior at MIT,Īnd this is my obligatory online presence or whatever. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |