-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathindex.xml
64 lines (46 loc) · 4.68 KB
/
index.xml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
<?xml version="1.0" encoding="utf-8" standalone="yes" ?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
<channel>
<title>Chaitanya Mukka's HomePage</title>
<link>https://mukkachaitanya.github.io/index.xml</link>
<description>Recent content on Chaitanya Mukka's HomePage</description>
<generator>Hugo -- gohugo.io</generator>
<lastBuildDate>Thu, 31 May 2018 22:24:46 +0530</lastBuildDate>
<atom:link href="https://mukkachaitanya.github.io/index.xml" rel="self" type="application/rss+xml" />
<item>
<title>About</title>
<link>https://mukkachaitanya.github.io/about/</link>
<pubDate>Thu, 31 May 2018 22:24:46 +0530</pubDate>
<guid>https://mukkachaitanya.github.io/about/</guid>
<description><p>Hi this is Chaitanya Mukka! Pleased to meet you. Have a look at my <a href="https://mukkachaitanya.github.io/posts">Blog</a>!</p>
</description>
</item>
<item>
<title>Week 1 : Setting Up Hadoop</title>
<link>https://mukkachaitanya.github.io/posts/week-1-setting-up-hadoop/</link>
<pubDate>Sun, 27 May 2018 21:20:33 +0530</pubDate>
<guid>https://mukkachaitanya.github.io/posts/week-1-setting-up-hadoop/</guid>
<description><p>Hi Everyone!</p>
<p>The first week of my internship IISc as a project trainee has ended. There was some exciting work this week. We completed introduction to Clay Codes and moved forward to work with setting up Hadoop.</p>
<p>Setting up Hadoop came with various hurdles. There weren&rsquo;t many good tutorials online which talked about developmemt setup of hadoop. Build dependecies created serious problems on Ubuntu 18.04. Spent more than a day to figure out it&rsquo;s the distribution&rsquo;s issue. Still need to figure out what went wrong. Tried setting it up using out of the box docker setup, available in the Hadoop&rsquo;s repo, but didn&rsquo;t seem to work well.</p>
<p>Later resorted to setting it up on a vagrant Ubuntu Xenial machine, all was smooth then. Faced some common issues related to versions of various dependencies and found the solutions to most of them online.</p>
<p>Joined the Hadoop developer <a href="https://hadoop.apache.org/mailing_lists.html">mailing list</a> late into the week. Positive that it would help us a lot.</p>
<p>I will be writing a tutorial later on the setup to ease out the process for other new Hadoop developers.</p>
</description>
</item>
<item>
<title>Week 0 : Internship Begins</title>
<link>https://mukkachaitanya.github.io/posts/week-0-internship-begins/</link>
<pubDate>Sat, 19 May 2018 21:11:50 +0530</pubDate>
<guid>https://mukkachaitanya.github.io/posts/week-0-internship-begins/</guid>
<description><p>Hi everyone!</p>
<p>I would be writing this blog series to document my internship at Code and Design Lab, IISc.</p>
<p>The internship came out to me as a surprise as <a href="http://ece.iisc.ernet.in/~vijay/">Dr.P.V.Kumar</a> replied to my mail which was over a month old and I had to have a interview on the day my semester exams ended. Luckily I could do well at the unprepared interview, taken by Myna Vajha et al., and well got selected for the internship.</p>
<p>For the next two months I would be working to implement the theoretical framework of <a href="https://www.usenix.org/conference/fast18/presentation/vajha">Clay Codes</a>, which are a high rate MSR (maximum regenerating codes) erasure codes for distributed storage, in HDFS in Hadoop 3.0.</p>
<p>Erasure codes in storage for distributed systems perform very well over the popular 3x replication and are known to reduce storage overheads significantly to less than 50% compared to that of 200% former. But they also come with computation and network bandwidth considerations. MSR codes are vector codes which try to optimise the repair bandwidth, which is the amount of data required to recover lost data nodes (storage units). Erasure codes were introduced to Hadoop in its 3.0 release.</p>
<p>These initial days at my internship were spent setting up my PC and getting it ready for installation of Hadoop. Also spent the major part of the week in understaning Erasure coding, through a lecture series by Vinayak and getting settled with the team. Hope to learn more about Clay Codes and their framework. Will try to write a post compiling the details about the same.</p>
<p>That&rsquo;s all folks for this week.</p>
</description>
</item>
</channel>
</rss>