Port 25: The Open Source Community at Microsoft : Community, Interop, .NET Development

PDC 2009: Availability of the Windows Azure Platform

Peter Galli — Tue, 17 Nov 2009 18:14:00 GMT

Ray Ozzie, Microsoft's Chief Software Architect, used the company's annual Professional Developers Conference here in Los Angeles to announce the availability of the Windows Azure platform.

That platform consists of Windows Azure, the operating system as-a-service, and SQL Azure, a fully relational database in the cloud. The Service Bus and Access Control services, formerly known as the .NET Services, now run directly within Windows Azure and are known as Windows Azure platform AppFabric Service.

Microsoft will continue to offer Windows Azure as a Community Technology Preview until the end of this year, after which it will switch to a production service under which Azure's cloud services will be made available to enterprises. But users will get a fee pass in January, since charges will only start accruing in February.

In his opening keynote, Ozzie also announced that a small number of customers will go into production today, including Automattic, Inc., the maker of WordPress, which is now live on Azure. Matt Mullenweg, founder of Automattic, Inc., took the stage to demonstrate MySQL, PHP, and Apache support on Windows Azure, as well as to announce that his company is launching a new site that runs on SQL Azure.

Ozzie also used his keynote to made clear that reaching all developers was top of mind for Microsoft.

"To most developers, to developers like you, Windows Azure appears as a model based extension to Visual Studio, enabling you to build apps that leverage your skills in SQL, IIS, ASP.NET, and .NET Framework. Alternatively, and of course it's your choice, you might leverage your skills by using MySQL and PHP within Azure, or you might instead take advantage of our new Azure tools for Java and Eclipse. Reaching all developers is incredibly important to us," he said.

Windows Azure now supported any kind of Windows code and programming model, and any kind of multi-role, multi-tier service design pattern, supporting extremely flexible binding and arbitrary relationships between roles, Ozzie said.

"Because you wanted it, we've broadened far beyond just the .NET programming model, and the Web role, worker role service design pattern. We added support for FastCGI, enabling high scale Web apps to be written in any of a variety of programming languages. And, in sessions this week, you're going to see the Windows Azure team quickly building and deploying Java apps, running under Tomcat. You'll see PHP apps under MySQL," he said.

Earlier this year, Microsoft enabled .NET full trust and native code applications. This functionality allowed developers to spawn xcopy deployable processes. As a result, Java applications can now be packaged and run.

Today, we announced that we are delivering a solution accelerator for Tomcat, an open source software implementation of the Java Servlet and JavaServer Pages technologies, as well as launching a Java SDK for Windows Azure Storage (tables, blogs, and queues). External endpoints (inbound traffic) to worker roles have also been enabled, which enables applications that receive internet traffic that aren't running under IIS.

During his keynote Ozzie also introduced Vivek Kundra, the Federal Chief Information Officer at the White House, who spoke via live feed from Washington D.C., and who encouraged developers to take advantage of the vast amount of public data to create applications using this new Microsoft technology.

"I'm really excited about what NASA is doing in cooperation with Microsoft with the launch of the Pathfinder Innovation Challenge ... anybody can participate and look at the data that has been democratized through NASA on the Azure platform, that allows people to look around the red planet, slice and dice, and cube, and create information, and advance our understanding of the universe," Kundra said.

This commitment to all developers is not new. When Ozzie first announced the Windows Azure platform at PDC last year, Sam Ramji blogged that developers will also be able to choose from a range of open source development tools and technologies, and be able to access Azure services using a variety of common internet standards, including HTTP, REST, WS* and Atom.

"The Azure platform's goal is to support all developers and their choice of IDE, language and technology. We are also providing programmable components that can be consumed by other applications, and Microsoft is funding and sponsoring open source software development kits to enable Java and Ruby developers to take advantage of Azure. This is significant as this is the first time we are delivering cross-platform software development kits at the same time as Microsoft Developer Network software development kits," he said.

And, earlier this year, Microsoft introduced the PHP SDK for Windows Azure, an open source effort for which Microsoft has provided funding, with development by RealDolmen, whose goal is to provide high-level abstractions that enable PHP developers to interoperate readily with Windows Azure.

The PHP SDK for Windows Azure focuses on REST and provides PHP classes for Windows Azure blobs, tables and queue, helper classes for HTTP transport, AuthN/AuthZ, REST and error management, as well as manageability, instrumentation and logging support.

Next up at PDC 2009 was Bob Muglia, President of Microsoft's Server and Tools Business, who noted that Microsoft is converging on a common developer platform for both servers and services, that will enable developers to continue using familiar .NET Framework and Visual Studio tools and technologies, as well as third party tools such as Eclipse, to create and monetize applications that run on the server and as services in the cloud.

Muglia also announced the company's plan to offer Windows Server Virtual Machine support on Windows Azure, enabling customers to more easily support virtualized infrastructure across the continuum of on premises and cloud computing.

In addition, Muglia announced the new release of ASP.NET MVC beta 2, a free, fully-supported framework that enables developers to rapidly build standards-based Web applications through rich AJAX integration and enhanced extensibility.

In other related news, SugarCRM, a provider of commercial open source customer relationship management software, today also announced that it will offer its CRM applications on Windows Azure to enable its customers and value-added resellers to benefit from the real-time scalability, high availability and on-demand infrastructure of Azure.

"With Windows Azure, Microsoft has built a true cloud computing platform going well beyond the simple hosted infrastructure that most service providers offer today. Windows Azure enables SugarCRM value-added resellers to create and deploy unique solutions for customers around the globe. This new service is another key component of the Sugar Open Cloud, the SugarCRM cloud strategy for delivering simple, affordable CRM anywhere based on customer need," said Larry Augustin, CEO of SugarCRM, in a press statement.

New Bridge Broadens Java and .NET Interoperability

Peter Galli — Tue, 29 Sep 2009 15:31:00 GMT

Microsoft continues to deliver on its ongoing promise to build bridges between different technologies, and this week jointly announced with Noelios Technologies a new interoperability bridge between Java and .NET through REST.

The Microsoft Interoperability Technical Strategy team has been working with Noelios to build an extension to the Restlet Framework. As such, Noelios has released a new bridge for Java and .NET. It is shipping a new version of the Restlet open source project, a lightweight REST framework for Java.

This includes the Restlet Extension for ADO.NET Data Services, which makes it easier for Java developers to take advantage of ADO.NET Data Services, a set of recently added .NET Framework features that provides a simple way to expose a wide range of data sources, such as relational databases, XML files, and so on, through a RESTful service interface.

This announcement is yet another example of Microsoft's continued commitment to openness and interoperability, and demonstrates the ever increasing use of web standards in our technologies.

Formerly known as Project Astoria, the ADO.NET Data Services defines a flexible addressing and query interface using a URL convention, and supports the usual resource manipulation methods for data sources, including the full range of Create, Read, Update, and Delete operations.

Microsoft Visual Studio 2008 SP1 and the upcoming Visual Studio 2010 fully support ADO.NET Data Services, including the capability to create and consume data services directly from the development environment.

You can find all the technical details of this announcement on the Interoperability team blog here, as well as on the Noelis blog. You can also find a tutorial on this here.

The PHP Toolkit for ADO.NET Data Services

Peter Galli — Fri, 21 Aug 2009 11:00:00 GMT

Today, the DPE Interop team at Microsoft released a new open source project that bridges PHP and .NET using REST.

Specifically, the PHP Toolkit for ADO.NET Data Services was made available, which makes it easier for PHP developers to take advantage of the ADO.NET Data Services, a set of features recently added to the .NET Framework.

The PHP Toolkit for ADO.NET Data Services is an open source project funded by Microsoft and developed by Persistent Systems. It is available on CodePlex today.

These services, which were previously referred to by the codename Project Astoria, expose a wide range of data sources through a RESTful service interface.

There is full support for ADO.NET Data Services in Visual Studio 2008 SP1 as well as in the upcoming Visual Studio 2010, which includes direct support for both creating and consuming data services directly from the development environment.

Read more about all this on the Interoperability blog, and watch the Channel 9 video interview with Claudio Caldato, Senior Program Manager in the Interoperability Technical Strategy team, and Pablo Castro, software architect of ADO.NET Data Services.

This is yet another example of Microsoft's continued commitment to openness and interoperability as well as of its embrace of Web standards in its technologies.

Better Windows Development Environments - One project at a Time

Mark Stone — Fri, 10 Apr 2009 14:45:00 GMT

Discussions of the PC market usually break down into "desktop" vs. "server", as if these are the only platform categories. However, the developer's dev box -- call it a "workstation" to distinguish it from desktop -- is really a separate platform. Remember, when Linus Torvalds created Linux it wasn't because he needed a better
desktop operating system, or a better server operating system. What he wanted was something that could run the gcc compiler. He wanted a developer workstation he could use at home.

Of course the developer workstation market influences other markets. Developers who develop on a platform are more likely to develop for a platform. So winning developer mind share is often about giving them what they want in the way of development environment. And in this regard, open source developers are something of a
different breed.

Microsoft has a great set of developer tools; I've certainly known developers who swear by Visual Studio. But there's something of a disconnect between graphical tools favored by Windows developers and then command line tools favored by traditional open source developers; I've also known developers whose first order of business
with a new Windows workstation is to GNU-ify it.

Ironically, the Internet has a convergence effect, drawing these two camps together. Put developers online, and they can collaborate. Put developers online, and they can not only develop, but they can build, deploy, and test. The workstation has become not so much a computer as an environment. The developer's toolkit includes version control, build management, automated testing, and the need to do all these things as a team rather than an individual. Developer environments have evolved rapidly to adapt to these changes.

The Apache Software Foundation (ASF) seems to understand this evolution as well as anyone, and a number of ASF projects focus specifically on tools for the developer environment (Ant, Buildr, Continuum, Gump, and Maven come to mind as a few examples).

What's interesting is to see the .NET developers following suit, and wanting these same sorts of tools for their development environment. What's surprising is that this .NET effort is very grass roots driven.

"Panday" is a Filipino word meaning "blacksmith", and can also be a reference to the graphic novel super hero of the same name (the graphic novel is also originates from the Philippines). This provides an appropriate metaphor for the name of the NPanday project on Codeplex.

The NPanday project is one of several affiliated with Microsoft's Open Source Lab in the Philippines, and is part of the effort to bring to .NET some of the capabilities found in other open source development environments. The aim of NPanday is integrate Apache Maven into the .NET development environment.This would enable .NET
developers to take advantage of Maven-compatible development infrastructure.

Projects like NPanday are important because they offer developers more choice of tools in a Windows development environment. The more familiar those tools are to open source developers, the more open source development will be done on and for Windows. NPanday is also an important project for interoperability, making it easier to integrate .NET development with other development done using Maven.

Expanding the interoperability of eclipse4SL: Mac support comes to the Eclipse for Silverlight project

Vijay Rajagopalan — Wed, 18 Mar 2009 18:15:00 GMT

In October 2008, when Microsoft announced the general availability of Silverlight 2.0, and, as part of Microsoft’s ongoing commitment to interoperability, Microsoft and Soyatec unveiled the Eclipse Tools for Silverlight (Eclipse4SL).

Today, Microsoft and Soyatec are expanding our interoperability collaboration by releasing a Community Technology Preview (CTP) of the eclipse4SL project that includes support for the Macintosh platform. Mac and Windows developers can now collaborate on Silverlight projects using the Eclipse or Visual Studio IDEs. We have also added several new features to the project that should please all developers like C# code generation and improved XAML auto-completion (check out our Interoperability Team blog for more details and a demo)

As an open source initiative sponsored by Microsoft (funding and architectural guidance) and led by Soyatec (development), the eclipse4SL project is released under the Eclipse Public License Version 1.0 on SourceForge.net and was submitted by Soyatec it to the Eclipse Foundation as an open Eclipse project. Since its inception the project has received lots of feedback and made significant progress. eclipse4SL has been among the “Top Rated” projects on www.eclipseplugincentral.com for weeks:

(Screenshot taken on 03/16/2009)

For more information, visit the Eclipse for Silverlight web site, or join the discussion at http://www.eclipse4sl.org/community/.

Vijay Rajagopalan, Principal Architect in the Interoperability Strategy Team at Microsoft.

Better Tools for Web Development

Mark Stone — Wed, 18 Mar 2009 15:10:00 GMT

Several years ago I was helping a musician friend of mine set up a web site to use as a promotional site for his live performances. I opted for a simple, PHP-based Content Management System (CMS) that wouldn’t require any special knowledge for him to post new information, and would be – famous last words – easy for me to set up and maintain.

Not having done professional web development for some time, I quickly found myself on the phone to one of my PHP guru friends. After editing three configuration files (two for the web server, one for PHP itself), and adjusting to make sure we had the right version of PHP running with the right version of MySQL, we finally got everything working, and the CMS properly installed and configured.

This small example has several instructive lessons:

Getting software components working together properly is hard. The open source community takes real pride in tackling this challenge, having delivered tools like make, dpkg, and apt. Even so, simple cases can fail and mire you in complexity.
None of this is where web developers want to spend their time. The creative, innovative work is all done once you have the right components in place.
Absent perfect tools (which we’ll probably never have), you want to have the collective knowledge of your developer community working for you. Without my friend on the phone, I’d have had a much bigger problem on my hands.

So there’s something very liberating about seeing Microsoft offer better tools and facilitate better community collaboration so that web developers can spend more time on creative work and less on component complexity.

I’m referring specifically to the Microsoft Web Platform: Web Platform Installer 2.0 Beta (WebPI) and Windows Web Application Gallery, announced today at MIX ’09.

WebPI provides a single online destination and a single process for downloading and installing Microsoft’s freely available web products. By itself this may seem like no more than much-needed common sense, a good effort by Microsoft to help web developers get all the components they need working together more easily and more effectively.

What makes this development really interesting is the Web Application Gallery, an opportunity for web developers to participate and collaborate in a knowledge marketplace of shared components. In other words any web developer who follows certain basic guidelines can add their product to the Gallery, and be part of this ecosystem/community of shared web development activity. This is an opportunity not just to market your work, but share ideas and innovations with other web developers, and indeed let them build on your work.

Does that sound reminiscent of an open source community? It should. While there is no requirement that Gallery code be open source, the spirit behind this effort is very much one of collaboration. The Gallery is based on the idea that web developers collectively can advance their work more than each can individually.

Nor is this a playground strictly for Microsoft technologies. There are two supported web development frameworks in the Gallery: .NET and PHP. Opening up the world of PHP applications for Windows is an exciting prospect. There is at least the possibility that something like Word Press on Windows Server will be a point and click install. We aren’t there yet. WebPI installs SQL Server by default, and MySQL is still a manual install. Many web developers won’t – or shouldn’t – care about the difference, but to some it will matter.

But this is definitely a step along the right path, one step closer to making PHP an operating system-agnostic language. Because a PHP developer should care only about building great apps.

Brazilian Students Set Their Own Course

Mark Stone — Mon, 16 Mar 2009 19:05:00 GMT

I’m going to tell a story that starts in Indiana, but really it’s about Brazil.

Once upon a time “scientific computing” was nearly synonymous with “Fortran”. Today, though, just about any high level language can be used to write High Performance Computing (HPC) applications. These days that language choice also includes C#.

At Indiana University, the Open Systems Lab has pioneered work to implement Message Passing Interface (MPI) support for .Net, so that MPI applications can be written in C#. The project is MPI.Net, and you can find it on Codeplex. It is open source, about three years old, has reached a 1.0 release, and is compatible with two other important open source projects, OpenMPI and Mono. The principle developers behind the project are Andrew Lumsdaine at Indiana University and his former student, Douglas Gregor, who is now on the faculty of Rensselear Polytechnic Institute.

This is the kind of open source work that’s really exciting to see because of the way it expands choices for the developer and the end user. A C# developer should not be closed off from writing HPC applications if that’s what they want to do. And a research scientist should not have to think about whether their lab is running Linux or Windows Server. Both of these individuals are working enough layers above the operating system that somebody else’s operating system choice should not be a constraint.

So I was very excited to learn that students in Brazil at Federal University of Rio Grande do Sul were doing work on MPI, and excited to talk with them about their work. One of their projects is MPI#, also open source and also hosted on Codeplex.

MPI# builds on top of the work of MPI.Net, adding some functionality not yet present in MPI.Net. Specifically, quoting from the project description:

The goals of this project would be to build upon MPI.NET in order to complement it with the features that are missing, mainly regarding collective communication. Either they could benefit from C# native support for such communication, either they could be programmed on top of the provided MPISend/MPIRecv encapsulations. C# and .NET features such as fault tolerance or dynamicity support would be studied, in other to turn the MPI# implementation robust in large, dynamic and heterogeneous platforms.

Two of the students working on MPI# are Ismael Stangherlini and Fernando Afonso. They are graduate students in computer science, working on projects affiliated with the Brazilian Interoperability and Open Source Software Development Nucleous. When I talked to them about their work on MPI# I was curious what their communication with Indiana University had been like. Their response: they had never been in contact with Indiana University; they simply downloaded the code for MPI.Net and started working on their own.

That’s the magic of open source: that they can, in fact, just download the code on their own and start coding against it. They may make an important contribution to MPI.Net. Or their code may be entirely disregarded. Or they may move on to other projects and somebody else may or may not pick up where they left off. At this stage it’s too early to tell. But the fact that all of these scenarios are possible demonstrates why, as a methodology, open source is so nimble and adaptive. A top-down product development process, or a top-down standards development process can only execute on the innovations envisioned by the few at the top, and at the speed of the slowest decision-makers in the process. But a bottom-up open source process enables every innovation that anyone at the grass roots level can see.

Moonlight 1.0 Hits the Street

Peter Galli — Wed, 11 Feb 2009 19:42:00 GMT

Moonlight 1.0 is now available.

Moonlight is an open source project that gives Linux users access to Microsoft Silverlight content, and is available for all major Linux distributions, including openSUSE, SUSE Linux Enterprise, Fedora, Red Hat, and Ubuntu. This milestone release is part of the technical collaboration between Novell and Microsoft.

Microsoft has worked with the Moonlight team and Novell to enable interoperability between Windows and Linux platforms and extend the high-quality interactive Web and video experience for the benefit of the Linux community, said Scott Guthrie, corporate vice president of Microsoft's .NET Developer Division.

Microsoft has provided Novell with access to its test suites for Silverlight, and provides Linux end users of Moonlight with free access to the Microsoft Media Pack, a set of licensed media codecs for video and audio that bring optimized and licensed decoders to every Linux user using Moonlight. Windows Media Video (.wmv), Windows Media Audio (.wma) and MP3 files are supported through the Microsoft Media Pack.

A pre-release of Moonlight was made available on January 19, 2009 to allow Linux users to stream Barack Obama's Inauguration, and more than 20,000 Linux users downloaded Moonlight to watch that Silverlight broadcast.

"Microsoft Silverlight offers the most comprehensive and powerful solution for the creation and delivery of rich internet applications and media experiences, and is used by hundreds of thousands of developers worldwide," Guthrie said.

For his part Miguel de Icaza, the founder of the Mono project founder and vice president of Developer Platforms at Novell, said Moonlight brings the benefits of Silverlight's popular multimedia content to Linux viewers. "This first release delivers on the goal of breaking down barriers to multimedia content and creating parity in the user's viewing experience regardless of whether the user is on Windows or Linux."