Tag Archive | "Technology"

Tags: , ,

Big Data …. The Big Picture !

Posted on 09 July 2015 by Sadhan

Big data analytics is the process of examining large data sets containing a variety of data types — i.e., big data — to uncover hidden patterns, unknown correlations, market trends, customer preferences and other useful business information. The analytical findings can lead to more effective marketing, new revenue opportunities, better customer service, improved operational efficiency, competitive advantages over rival organizations and other business benefits.

big-data

 

The primary goal of big data analytics is to help companies make more informed business decisions by enabling data scientists, predictive modelers and other analytics professionals to analyze large volumes of transaction data, as well as other forms of data that may be untapped by conventional business intelligence (BI) programs. That could include Web server logs and Internet clickstream data, social media content and social network activity reports, text from customer emails and survey responses, mobile-phone call detail records and machine data captured by sensors connected to the Internet of Things. Some people exclusively associate big data with semi-structured and unstructured data of that sort, but consulting firms like Gartner Inc. and Forrester Research Inc. also consider transactions and other structured data to be valid components of big data analytics applications.

Big data can be analyzed with the software tools commonly used as part of advanced analytics disciplines such as predictive analytics, data mining, text analytics and statistical analysis. Mainstream BI software and data visualization tools can also play a role in the analysis process. But the semi-structured and unstructured data may not fit well in traditional data warehouses based on relational databases. Furthermore, data warehouses may not be able to handle the processing demands posed by sets of big data that need to be updated frequently or even continually — for example, real-time data on the performance of mobile applications or of oil and gas pipelines. As a result, many organizations looking to collect, process and analyze big data have turned to a newer class of technologies that includes Hadoop and related tools such as YARN, MapReduce, Spark, Hive and Pig as well as NoSQL databases. Those technologies form the core of an open source software framework that supports the processing of large and diverse data sets across clustered systems.

The Challenges of Big Data Analytics:

For most organizations, big data analysis is a challenge. Consider the sheer volume of data and the different formats of the data (both structured and unstructured data) that is collected across the entire organization and the many different ways different types of data can be combined, contrasted and analyzed to find patterns and other useful business information.
The first challenge is in breaking down data silos to access all data an organization stores in different places and often in different systems. A second big data challenge is in creating platforms that can pull in unstructured data as easily as structured data. This massive volume of data is typically so large that it’s difficult to process using traditional database and software methods.

For most organizations, big data analysis is a challenge. Consider the sheer volume of data and the different formats of the data (both structured and unstructured data) that is collected across the entire organization and the many different ways different types of data can be combined, contrasted and analyzed to find patterns and other useful business information.
The first challenge is in breaking down data silos to access all data an organization stores in different places and often in different systems. A second big data challenge is in creating platforms that can pull in unstructured data as easily as structured data. This massive volume of data is typically so large that it’s difficult to process using traditional database and software methods.

In some cases, Hadoop clusters and NoSQL systems are being used as landing pads and staging areas for data before it gets loaded into a data warehouse for analysis, often in a summarized form that is more conducive to relational structures. Increasingly though, big data vendors are pushing the concept of a Hadoop data lake that serves as the central repository for an organization’s incoming streams of raw data. In such architectures, subsets of the data can then be filtered for analysis in data warehouses and analytical databases, or it can be analyzed directly in Hadoop using batch query tools, stream processing software and SQL on Hadoop technologies that run interactive, ad hoc queries written in SQL.

Potential pitfalls that can trip up organizations on big data analytics initiatives include a lack of internal analytics skills and the high cost of hiring experienced analytics professionals. The amount of information that’s typically involved, and its variety, can also cause data management headaches, including data quality and consistency issues. In addition, integrating Hadoop systems and data warehouses can be a challenge, although various vendors now offer software connectors between Hadoop and relational databases, as well as other data integration tools with big data capabilities.

 


Comments (0)

Tags: , ,

Google Fiber

Posted on 28 July 2012 by Sadhan

A New Technology Concept … from Google !

Google Fiber is a project to build an experimental broadband internet network infrastructure using fiber-optic communication in Kansas City, Kansas, and Kansas City, Missouri, following a selection process.

Over 1,100 communities applied to be the first recipient of the technology. On March 30, 2011, Google announced that Kansas City, Kansas will be the first community where the experimental network would be deployed.On May 17, 2011, Google announced that the service would be expanded to include the Kansas City, Missouri metropolitan area.

On July 24, 2012, Google announced that Fiber would become available that day. Neither pricing nor initial availability were mentioned. Google Fiber will focus to become an alternative to Verizon’s FiOS and AT&T’s U-verse services among other major cable companies.

On July 26, 2012, Google announced that it would roll out a companion fiber optic television service in the Kansas City area that September called Google Fiber TV, which will be offered as a conventional pay television service and will also stream live program content on iPad and Android tablet computers. Neighborhoods that initially receive both the TV and internet services are to be selected through demand from Kansas City area residents.The initial channel lineup for the service does not currently include cable television networks owned by Time Warner, The Walt Disney Company, AMC Networks, and News Corporation, which may eventually be added pending carriage agreements with those companies.



 


Comments (0)

Tags: , , , ,

Social Networking Map

Posted on 18 September 2010 by Sadhan

Social Networking-O-Sphere

The infographic below shows the number of users on each network, and their respective portion of those users overlap with the huge mobile “sun.” For instance, Facebook so far has 500 million active users, with roughly one-third of them accessing their accounts via mobile devices.

Things and numbers are changing very fast with the exponential growth of mobile devices and with its associated apps. I am sure we need to revise these stats sooner with the changing numbers in mobile domain.

credit: compete.com

enjoy…. Happy reading !


Comments (0)

Tags: , , ,

4G Technology

Posted on 07 August 2010 by sadhan

4G Technology

Under the Mobile Technology domain G is said to be the Generation and it covers the major advances in the range of 20-30 years. 1G technology involved the first widely available mobile phones. 2G technology, which started in the early 1990s, switched to a digital format and introduced text messaging. 3G technology improved the efficiency of how data is carried, making it possible to carry enhanced information services such as websites in their original format. The latest iPhone is the best known example of 3G technology. Meanwhile, just to mention, that iPhone 4 is Not a 4G phone !

Currently 3G networks still send there data digitally over a single channel, OFDM is designed to send data over hundreds of parallel streams, thus increasing the amount of information that can be sent at a time over traditional CDMA networks.

4g

4G mobile is not yet established as an agreed set of standards, so its features are currently simply goals rather than requirements. As well as drastically increasing data transfer speeds, 4G mobile should use enhanced security measures. Another goal is to reduce blips in transmission when a device moves between areas covered by different networks. 4G mobile networks should also use a network based on the IP address system used for the internet.

Within the United States, there are two major systems offering 4G mobile technology. One is known as WiMax and is backed by Clearwire, a firm whose majority owner is Sprint Nextel. It began testing services in Baltimore in 2008 and was set to expand this into major new markets in 2009. Sprint intended to have 80 cities covered by the end of 2010.

The rival system, Long Term Evolution or LTE, is backed mainly by Verizon. It was expected to be ready for testing in 2010 but not available for widespread use until 2012. LTE’s backers hoped to overcome this disadvantage by offering faster speeds and producing cheaper equipment.

Unlike previous generations of mobile technology, 4G mobile will be widely used for internet access on computers as well as carrying cell phone communications. Customers in areas which have strong 4G coverage will be able to use it for a home broadband connection which doesn’t require any cabling to their household. It can also be used for accessing the internet on the move without having to be in a wireless hotspot such as those offered by some coffee shops, airports and libraries.

The 4G technology will be able to support Interactive services like Video Conferencing (with more than 2 sites simultaneously), Wireless Internet,etc. The bandwidth would be much wider (100 MHz) and data would be transferred at much higher rates. The cost of the data transfer would be comparatively very less and global mobility would be possible. The networks will be all IP networks based on IPv6. The antennas will be much smarter and improved access technologies like OFDM and MC-CDMA (Multi Carrier CDMA) will be used. Also the security features will be much better.
The WiMax lobby and the people who are working with the WiMax technology are trying to push WiMax as the 4G wireless technology. At present there is no consensus among people to refer to this as the 4G wireless technology. WiMax can deliver upto 70 Mbps over a 50Km radius. As mentioned above, with 4G wireless technology people would like to acheive upto 1Gbps (indoors). WiMax does not satisfy the criteria completely. Also WiMax technology (802.16d) does not support mobility very well. To overcome the mobility problem, 802.16e or Mobile WiMax is being standardised. The important thing to remember here is that all the researches for 4G technology is based around OFDM (Orthogonal frequency-division multiplexing). WiMax is also based on OFDM. This gives more credibility to the WiMax lobby who would like to term WiMax as a 4G technology. Since there is no consensus for the time being, we have to wait and see who would be the winner.

The 4G technology will be able to support Interactive services like Video Conferencing (with more than 2 sites simultaneously), Wireless Internet,etc. The bandwidth would be much wider ‎ (100 MHz) and data would be transferred at much higher rates. The cost of the data transfer would be comparatively very less and global mobility would be possible. The networks will be all IP networks based on IPv6. The antennas will be much smarter and improved access technologies like OFDM and MC-CDMA (Multi Carrier CDMA) will be used. Also the security features will be much better.

global-4g-markets

The WiMax lobby and the people who are working with the WiMax technology are trying to push WiMax as the 4G wireless technology. At present there is no consensus among people to refer to this as the 4G wireless technology. WiMax can deliver upto 70 Mbps over a 50Km radius. As mentioned above, with 4G wireless technology people would like to acheive upto 1Gbps (indoors).

WiMax does not satisfy the criteria completely. Also WiMax technology (802.16d) does not support mobility very well. To overcome the mobility problem, 802.16e or Mobile WiMax is being standardised.

The important thing to remember here is that all the researches for 4G technology is based around OFDM (Orthogonal frequency-division multiplexing).

WiMax is also based on OFDM. This gives more credibility to the WiMax lobby who would like to term WiMax as a 4G technology. Since there is no consensus for the time being, we have to wait and see who would be the winner.

More Gs are awaiting as we progress in the path of connectivity… keep evolving !


Comments (0)

Tags: , , ,

Agile Methodology

Posted on 06 August 2010 by Sadhan

Agile Methodology

Nowadays we hear much about Agile Methodologies, especially in the context when we want to jumpstart any development quickly without the documentation part and where requirements are not very clear at the beginning.

To put it in simple words, this methodology is another style of software development that has been characterized by quick start on development, less documentation, change driven and iterative.

agile-Scrum methodology

In other words, Agile software development is a conceptual framework for undertaking software development projects that can get developed fast without the strict classic guidelines of maintaining the entire life-cycle of the project.

All Agile methodologies generally engage in an iterative workflow and follow an incremental way to deliver software in short time-boxed situations. An iteration could be a small release of software or results being achieved at short intervals. Naturally in these time-boxed development situations, things like coding, design and testing will run in parallel and Iterations are typically a fixed length and this length will depend on the chosen methods under Agile. Each iteration can be referred as a cycle in this context of Agile Methodologies.

There are a number of agile software development methods, most of them give the same time-boxed iterations approach, which could typically last one to four weeks but again depends on the nature of the project. Each iteration is like a miniature software project of its own, and includes all of the tasks necessary to release the mini-increment of new functionality: planning, requirements analysis, design, coding, testing, and documentation.

The most popular Agile methodologies in use today appear to be Extreme Programming (XP), Scrum, Feature Driven Development (FDD), Lean Software Development, Agile Unified Process (Agile UP or AUP), Crystal, and Dynamic Systems Development Method (DSDM).

Some of the principles behind the Agile are:

  • Customer satisfaction by rapid, continuous delivery of useful software
  • Working software is delivered frequently (weeks rather than months)
  • Working software is the principal measure of progress
  • Even late changes in requirements are welcomed
  • Close, daily, cooperation between business people and developers
  • Face-to-face conversation is the best form of communication
  • Projects are built around motivated individuals, who should be trusted
  • Continuous attention to technical excellence and good design
  • Simplicity
  • Self-organizing teams
  • Regular adaptation to changing circumstances

Agile home ground:

  • Low criticality
  • Senior developers
  • Requirements change very often
  • Small number of developers
  • Culture that thrives on chaos

Criticisms include:

  • lack of structure and necessary documentation
  • only works with senior-level developers
  • incorporates insufficient software design
  • requires too much cultural change to adopt
  • can lead to more difficult contractual negotiations

Agile methods are sometimes characterized as being at the opposite end of the spectrum from “plan-driven” or “disciplined” methods. This distinction is misleading, as it implies that agile methods are “unplanned” or “undisciplined”. A more accurate distinction is that methods exist on a continuum from “adaptive” to “predictive”. Agile methods lie on the “adaptive” side of this continuum.

Some mistakenly believe that Agile methods avoid planning. This is a misconception, as Agile methods pay considerable attention to planning. However, Agile methods apply a planning process that is adaptive so as to accommodate inevitable change. Traditional, non-Agile methods tend to apply predictive planning that resists change and suffers the consequence of conflict between static plans and dynamic reality. Agile development has been widely documented as applicable to small, co-located development teams. Agile methods are more suitable when requirements are emergent and rapidly changing; they are less suitable for systems that have high criticality, reliability and safety requirements, though there is no complete consensus on this point.


Comments (2)

Tags: , , ,

Epic 'Indian' Browser … latest entrant

Posted on 31 July 2010 by sadhan

New Epic Browser

It’s the browser which takes to the world of websites and makes our browsing experience better with the variety of add-ons stuff. No wonder, there is a competitive war with these browsers in the market to capture for web-audience. Since earlier days, when we had only 2 prominent browsers like Netscape Navigator and Internet Explorer, we have come across a long way and now have the options like Mozilla Firefox, IE, Google Chrome, Mac Safari and so on….
In this browsers domain, here is the latest entrant and that too from India. Hidden Reflex, a Bangalore based startup, came with another interesting ‘Indian’ browser, called the ‘Epic Browser’.
This has been developed based on Mozilla. This browser wants to capture the Indian audience with the service offerings like share market and Cricket updates, video streams and more.
It also has a built-in Antivirus solution to prevent malwares and Trojans etc. This bowser has over 1500 applications and also it supports Firefox add-ons. So to catch it live why don’t you try it …. You can download Epic browser from here.
Happy Browsing !

It’s the browser which takes to the world of websites and makes our browsing experience better with the variety of add-ons stuff. No wonder, there is a competitive war with these browsers in the market to capture for web-audience. Since earlier days, when we had only 2 prominent browsers like Netscape Navigator and Internet Explorer, we have come across a long way and now have the options like Mozilla Firefox, IE, Google Chrome, Mac Safari and so on….

epic_browser

In this browsers domain, here is the latest entrant and that too from India. Hidden Reflex, a Bangalore based startup, came with another interesting ‘Indian’ browser, called the ‘Epic Browser’.

This has been developed based on Mozilla. This browser wants to capture the Indian audience with the service offerings like share market and Cricket updates, video streams and more.

It also has a built-in Antivirus solution to prevent malwares and Trojans etc. This bowser has over 1500 applications and also it supports Firefox add-ons. So to catch it live why don’t you try it …. You can download Epic browser from here.

Happy Browsing !


Comments (2)

Tags: , , ,

Innovations @ Microsoft Research Lab

Posted on 07 March 2010 by Ritz

Fascinating research projects presented at Microsoft’s TechFest 2010

tecfest

When brains at Labs are at work, we can  definitely expect some path breaking techno developments. at Redmond witnessed many such demos on various projects. Lets have a look at some of them:

1. The Translating phone and The Transcriptor: Transcriptor generates a live transcript of the coversation we have over a call on a PC based communicator. The scripts are merged in email as well for searching.

tran

The Translator is a wonderful concept that takes away the about the difference of language we might have over an important client call or anything like that. The translator translates the speech of the person on the other side of the phone to the language you want at real time. This 2-way translator also generates a live translated transcript. Find out more about the project @

gustov

2. Project Gustav: Project Gustav is a creative endeavor of Microsoft to make digital painting a perfect realistic experience. It is a realistic painting system prototype that simulates natural, real-world painting environment.

For a better knowhow of the project visit the official page on .

3. Skinput: Skinput is a technology that favors the skin of our body to be used as an input device. Various signals like location of finger taps are collected by sensors worn as armbands. To know more about the Skinput check out

skinput4

http://greatvines.com/levitra-order

mobilesurface

4. Mobile Surface: It aims at making any surface around you as a touch interface surface by linking together a mobile device, camera and a projector. It allows you to project an image on any surface and interact with it even without touching the image.

Click on for more information.

An altogether new world of technologies. Exciting!! Isn’t it?? Lets wait and watch how these project finally turn out. Till then keep reading and commenting.

When people in Microsoft Labs are at work, they always aim at taking technologies to a different dimension. Techfest 2010 at Redmond witnessed many such demos on various projects. Lets have a look at some of them:
The Translator and The Transcriptor: Transcript generates a live transcript of the coversation we have over a call on a PC based communicator. The scripts are merged in

email as well for searching.

The Translator is a wonderful concept that takes away the about the difference of language we might have over an important client call or anything like that. The translator translates the speech of the person on the other side of the phone to the language you want  at real time. This 2-way translator also generates a live translated transcript.
Find out more about the project @ http://research.microsoft.com/en-us/projects/transcriptor/default.aspx
Project Gustav: Project Gustav is a creative endeavor of Microsoft to make digital painting a perfect realistic experience. It is a realistic painting system prototype that simulates natural, real-world painting environment.
For a better understanding of the project visit http://research.microsoft.com/en-us/projects/gustav/default.aspx
Skinput: Skinput is a

technology that favors the skin of our body to be used as an input device. Various signals like location of finger taps are collected by sensors worn as armbands.

To further increase your understanding on the technology check out http://research.microsoft.com/en-us/projects/gustav/default.aspx
Mobile Surface: it aims at making any surface around you as a touch interface surface by linking together a mobile device, camera and a projector. It allows you to project an image on any surface and interact with it even without touching the image.
Click on http://research.microsoft.com/en-us/projects/mobilesurface/default.aspx for more information.
This is exciting!! An altogether new world of technologies. Isn’t it?? Lets wait and watch how these project finally turn out. Till then keep reading and don’t forget to comment.

Comments (1)

Advertise Here
Advertise Here
Digital Thought

Recent Posts

Announcement

Popularity Pointers

Tags



July 2015
M T W T F S S
« May    
 12345
6789101112
13141516171819
20212223242526
2728293031  
.

My Mobile Site:

http://m.sadhanbiswas.com

Get the Mobile Site of www.SadhanBiswas.com at your fingertips from anywhere.


Digital Thought on Facebook







 





   About Digital Thought | Terms | Advertising | Sitemap

RSS Feed Twitter Facebook Google